o iF @sddlZddlZddlZddlZddlZddlmZddlZddlZ ddl Z ddl m Z ddl mZddlmZmZmZddlmZdUd ed ed e jfd d Zde jde jd e jfddZdddde jdedBdedBd efddZdVde jdedBd e j fddZ  dWde jdedBded efddZdXde j ded efd d!ZdYde jded e jfd#d$Zde jd%ed e jfd&d'Z  dWde jdedBded efd(d)Z dZd,ej!d-ed.ed efd/d0Z"  d[d1ej#d-ej$dBd2ej%dBd efd3d4Z& * +dZd5e j'd6ed-ed.ed ef d7d8Z(d9e jd e j'fd:d;Z)d,ej!d efde+d ej#fd?d@Z,dAe jd e jfdBdCZ-dDe.d e/fdEdFZ0 G H I Jd\dKe jde jfdLdMZ1dKej d e jfdNdOZ2dPed efdQdRZ3dPed efdSdTZ4dS)]N)BytesIO)Image)common_upscale)Input InputImplTypes)mimetype_to_extensionRGBA image_bytesiomodereturncCs:t|}||}t|tjd}t| dS)aConverts image data from BytesIO to a torch.Tensor. Args: image_bytesio: BytesIO object containing the image data. mode: The PIL mode to convert the image to (e.g., "RGB", "RGBA"). Returns: A torch.Tensor representing the image (1, H, W, C). Raises: PIL.UnidentifiedImageError: If the image data cannot be identified. ValueError: If the specified mode is invalid. go@r) ropenconvertnparrayastypefloat32torch from_numpy unsqueeze)r r image image_arrayr>/mnt/c/Users/fbmor/ComfyUI/comfy_api_nodes/util/conversions.pybytesio_to_image_tensors  rimage1image2cCsZ|jdd|jddkr$t|dd|jd|jddddd}tj||fddS) z Converts a pair of image tensors to a batch tensor. If the images are not the same size, the smaller image is resized to match the larger image. rNbilinearcenterrdim)shapermovedimrcat)rrrrrimage_tensor_pair_to_batch's r'@ image/png) total_pixels mime_typerr*r+cCs<|sd}t||d}t||d}tdt||_|S)aConverts a torch.Tensor image to a named BytesIO object. Args: image: Input torch.Tensor image. total_pixels: Maximum total pixels for downscaling. If None, no downscaling is performed. mime_type: Target image MIME type (e.g., 'image/png', 'image/jpeg', 'image/webp', 'video/mp4'). Returns: Named BytesIO object containing the image data, with pointer set to the start of buffer. r)r*r+.) tensor_to_pilpil_to_bytesiouuiduuid4r name)rr*r+ pil_image img_binaryrrrtensor_to_bytesio8s   r6cCs^t|jdkr |d}|}|durt|d|d}|dtj }t |}|S)zVConverts a single torch.Tensor image [H, W, C] to a PIL Image, optionally downscaling.rNr,) lenr$cpudownscale_image_tensorrsqueezenumpyrruint8r fromarray)rr* input_tensorimage_npimgrrrr/Qs r/ image_tensorcCs4t||d}t||d}|}t|d}|S)aConvert [B, H, W, C] or [H, W, C] tensor to a base64 string. Args: image_tensor: Input torch.Tensor image. total_pixels: Maximum total pixels for downscaling. If None, no downscaling is performed. mime_type: Target image MIME type (e.g., 'image/png', 'image/jpeg', 'image/webp', 'video/mp4'). Returns: Base64 encoded string of the image. r,r-utf-8)r/r0getvaluebase64 b64encodedecode)rCr*r+r4 img_byte_arr img_bytesbase64_encoded_stringrrrtensor_to_base64_string^s  rLrBcCsH|sd}t}|dd}|dkrd}|j||d|d|S)z)Converts a PIL Image to a BytesIO object.r)/rJPGJPEG)formatr)rsplituppersaveseek)rBr+rI pil_formatrrrr0us r0cCs|dd}t|}t||jd|jd}|dkr|St|jd|}t|jd|}t|||dd}|dd}|S)zCDownscale input image tensor to roughly the specified total pixels.rrr7rlanczosdisabled)r%intmathsqrtr$roundr)rr*samplestotalscale_bywidthheightsrrrr;s  r;max_sidec Csx|dd}|jd|jd}}t||}||kr|S||}t||}t||}t|||dd} | dd} | S)zQDownscale input image tensor so the largest dimension is at most max_side pixels.rrrr7rWrX)r%r$maxr\r) rrcr]rar`max_dimr_ new_width new_heightrbrrr"downscale_image_tensor_by_max_sides     rhcCst|||}d|d|S)auConverts a tensor image to a Data URI string. Args: image_tensor: Input torch.Tensor image. total_pixels: Maximum total pixels for downscaling. If None, no downscaling is performed. mime_type: Target image MIME type (e.g., 'image/png', 'image/jpeg', 'image/webp'). Returns: Data URI string (e.g., 'data:image/png;base64,...'). data:;base64,)rL)rCr*r+ base64_stringrrrtensor_to_data_uris rlmp4aacaudiocontainer_format codec_namecCs>|d}|d}t|}t||||}|}t|dS)z+Converts an audio input to a base64 string. sample_ratewaveformrD)"audio_tensor_to_contiguous_ndarrayaudio_ndarray_to_bytesiorErFrGrH)rorprqrrrs audio_data_npaudio_bytes_io audio_bytesrrraudio_to_base64_strings ryvideocodeccCsTt}|j||pt|dtjj|pt|dtjjd|dt |  dS)a Converts a video input to a base64 string. Args: video: The video input to convert container_format: Optional container format to use (defaults to video.container if available) codec: Optional codec to use (defaults to video.codec if available) containerr{)rPr{rrD) rsave_togetattrrVideoContainerMP4 VideoCodecH264rTrFrGrErH)rzrpr{video_bytes_iorrrvideo_to_base64_strings  rrvrrc Cst}tj|d|dA}|j||d}tjj|d|jddkr!dndd }||_d|_| |D]}| |q0| d D]}| |q=Wd n1sOwY| d|S) zD Encodes a numpy array of audio data into a BytesIO object. wr rPratefltprrstereomonorPlayoutN) ravr add_stream AudioFrame from_ndarrayr$rrptsencodemuxrT) rvrrrprqrwoutput_container audio_streamframepacketrrrrus$    rurscCsh|jdks |jddkrtd|jddkr|d}|d}|jtj kr2| tj }|S)aG Prepares audio waveform for av library by converting to a contiguous numpy array. Args: waveform: a tensor of shape (1, channels, samples) derived from a Comfy `AUDIO` type. Returns: Contiguous numpy array of the audio waveform. If the audio was batched, the first item is taken. r7rrz5Expected waveform tensor shape (1, channels, samples)) ndimr$ ValueErrorr<r: contiguousr=dtyperrr)rsrvrrrrts   rtcCs|d}t}tj|ddd}|jd|dd}d|_tjj|d d  d d  d |j d d kr7d ndd}|d|_ d |_|||||d||d |S)Nrsrmp3r libmp3lamerrrirrrfltrrr)r:rrrrbit_raterrr%reshapefloatr=r$rrrrrcloserT)rors output_bufferr out_streamrrrraudio_input_to_mp3s"   r duration_secc Cs~t}d}d}z |}tj|dd}tj|ddd}d}d}|jD]P}td|jt|t|tj rT|j d|j d }|j |_ |j |_ d |_td |j |j |j q#t|tjrs|j d |jd }|j|_|j|_td |j|jq#|jjdj } t|| } | dd} | dkrtdd} d} |r|jddD]}| | krn||D]}||q| d7} q|D]}||qtd| | |r|d|jddD]}|j|krn||D]}||q| d7} q|D]}||qtd| |||dt|WSty>}z|dur'||dur0|tdt ||d}~ww)aQ Returns a new VideoInput object trimmed from the beginning to the specified duration, using av to avoid loading entire video into memory. Args: video: Input video to trim duration_sec: Duration in seconds to keep from the beginning Returns: VideoFromFile object that owns the output buffer Nr)r rrmrzFound stream: type=%s, class=%sh264ryuv420pz!Added video stream: %sx%s @ %sfpsrnz%Added audio stream: %sHz, %s channelsrz7Video too short: need at least 16 frames for Moonvalley)rzrz$Encoded %s video frames (target: %s))rozEncoded %s audio frameszFailed to trim video: )!rget_stream_sourcerrstreamslogginginfotype isinstance VideoStreamr average_rater`rapix_fmt AudioStreamrrrchannelsrzrYrrHrrrTtimerr VideoFromFile Exception RuntimeErrorstr)rzrrinput_containerr input_source video_streamrstreamfpsestimated_frames target_frames frame_countaudio_frame_countrrerrr trim_video&s~                     rwavcCsL|jjr|S|jtjkr|dS|jtjkr|dStd|j)zOConvert audio to float 32 bits PCM format. Copy-paste from nodes_audio.py file.ilzUnsupported wav dtype: )ris_floating_pointrint16rint32r)rrrr_f32_pcms    rrxc Cs4tt|p}|jjstd|jjd}t|jj}|}g}|j p$d}|j |j dD]C}| }t |} | jdkrB| d} n(| jd|krY| jd|krY| dd} n| jd|krj| d|} || q,Wdn1szwY|stdt j|dd} t| } | d|d S) z Decode any common audio container from bytes using PyAV and return a Comfy AUDIO dict: {"waveform": [1, C, T] float32, "sample_rate": int}. z"No audio stream found in response.rr)rrNzDecoded zero audio frames.r")rsrr)rrrrrorrY codec_contextrrrrHindex to_ndarrayrrrrr$ transposerrtappendr&r) rxafrin_srout_srframes n_channelsrarrbufrrrraudio_bytes_to_audio_inputs2       r nearest-exactrXTFmaskc Csd|j\}}}}|d}|dd}t|||||d}|dd}|s(|d}|s0|dk}|S)zaResize mask to be the same dimensions as an image, while maintaining proper format for API calls.rr)r`raupscale_methodcropg?)r$rr%rr<r) rrrrallow_gradientadd_channel_dim_rar`rrrresize_mask_to_images     rcCs|d}tj|gdddS)z]Make mask have the expected amount of dims (4) and channels (3) to be recognized as an image.rr7r")rrr&)rrrrconvert_mask_to_images rfilepathcCsBt|d }|}Wdn1swYt|dS)z(Converts a text file to a base64 string.rbNrD)rreadrFrGrH)rf file_contentrrrtext_filepath_to_base64_strings  rcCs2t|}t|\}}|durd}d|d|S)z#Converts a text file to a data URI.Nzapplication/octet-streamrirj)r mimetypes guess_type)rrkr+rrrrtext_filepath_to_data_uris r)r )r()r(r))r))rV)rmrn)NN)rrXTF)5rFrrZrr1iorrr=rrPILr comfy.utilsrcomfy_api.latestrrr_helpersr rTensorrr'rYr6r/rLr0r;rhrlAudioryVideorrrndarrayrurtrrrrbytesdictrrrrrrrrrs          l &