o i("@sddlmZddlZddlZddlmZddlmZddlmZm Z m Z ddl m Z ddl mZmZmZmZmZmZmZmZmZddlmZerNdd lmZGd d d e ZGd d d e ZGddde ZGddde ZGddde ZeGdddZ d#d$ddZ!d%d!d"Z"dS)&) annotationsN) dataclass)datetime) TYPE_CHECKINGAny TypedDict)Session) bulk_insert_assets'bulk_insert_references_ignore_conflictsbulk_insert_tags_and_metadelete_assets_by_idsget_existing_asset_idsget_reference_ids_by_ids%get_references_by_paths_and_asset_ids#get_unreferenced_unhashed_asset_idsrestore_references_by_paths) get_utc_now)ExtractedMetadatac@sbeZdZUdZded<ded<ded<ded<ded <ded <d ed <d ed<d ed<d ed<dS) SeedAssetSpecz*Spec for seeding an asset from filesystem.strabs_pathint size_bytesmtime_ns info_namez list[str]tagsfnamezExtractedMetadata | Nonemetadata str | Nonehash mime_typejob_idN__name__ __module__ __qualname____doc____annotations__r(r(=/mnt/c/Users/fbmor/ComfyUI/app/assets/services/bulk_ingest.pyrs  rc@s:eZdZUdZded<ded<ded<ded<d ed <d S) AssetRowz Row data for inserting an Asset.ridrrrrr r created_atNr"r(r(r(r)r*+s  r*c@sreZdZUdZded<ded<ded<ded<ded<ded <d ed <d ed <d ed<ded<ded<ded<dS) ReferenceRowz)Row data for inserting an AssetReference.rr+asset_id file_pathrrowner_idnamer preview_iddict[str, Any] | None user_metadatar!rr, updated_atlast_access_timeNr"r(r(r(r)r-5s  r-c@s2eZdZUdZded<ded<ded<ded<dS) TagRowzRow data for inserting a Tag.rasset_reference_idtag_nameoriginradded_atNr"r(r(r(r)r7Fs  r7c@sJeZdZUdZded<ded<ded<ded<d ed <d ed <d ed<dS) MetadataRowz&Row data for inserting asset metadata.rr8keyrordinalrval_strz float | Noneval_numz bool | Noneval_boolr3val_jsonNr"r(r(r(r)r<Os  r<c@s*eZdZUdZded<ded<ded<dS)BulkInsertResultzResult of bulk asset insertion.r inserted_refs won_paths lost_pathsNr"r(r(r(r)rC[s  rCsessionrspecslist[SeedAssetSpec]r0rreturncs|s tddddSt}g}g}iig}|D]s}tj|d}tt} tt} ||| |<| d} || | d|d| |d| d} | rX| } n |d rcd |d i} nd } || | ||d ||d d | | d|||d | |d|d | d| <qt ||t |dd|Dfdd|D}t ||t||t|}fdd|D}||}fdd|D}|rt|||stddt|dSfdd|D}t||}g}g}|r@|D]K}|} | }|d}||vrq|dD] }|||d|dq | d} | r+|| |q|d r?||d d|d d d d dqt|||dtt|t|t|dS)aSeed assets from filesystem specs in batch. Each spec is a dict with keys: - abs_path: str - size_bytes: int - mtime_ns: int - info_name: str - tags: list[str] - fname: Optional[str] This function orchestrates: 1. Insert seed Assets (hash=NULL) 2. Claim references with ON CONFLICT DO NOTHING on file_path 3. Query to find winners (paths where our asset_id was inserted) 4. Delete Assets for losers (path already claimed by another asset) 5. Insert tags and metadata for successfully inserted references Returns: BulkInsertResult with inserted_refs, won_paths, lost_paths r)rDrErFrr rr)r+rrr r,rrfilenameNrrr!) r+r.r/rr0r1r2r4r!r,r5r6r) reference_idrrLextracted_metadatacSsg|]}|dqSr.r(.0rr(r(r) z,batch_insert_seed_assets..csg|] }|dvr|qSrOr(rP)inserted_asset_idsr(r)rSscsh|] }|vr|qSr(r(rQpath)rUpath_to_asset_idr(r) s  z+batch_insert_seed_assets..csg|]}|qSr(r(rV)rXr(r)rSrTcsg|] }|dqS)rMr(rV)asset_id_to_ref_datarXr(r)rSsrM automatic)r8r9r:r;rN)r8r=r>r?r@rArB)tag_rows meta_rows)rCrosrWabspathruuiduuid4appendgetto_user_metadatar r r rrr lenrextend to_meta_rowsr )rHrIr0 current_time asset_rowsreference_rowsabsolute_path_listspec absolute_pathr.rMr rNr4 winning_pathsinserted_paths losing_pathslost_asset_idswinning_ref_idsinserted_ref_idsr\ metadata_rowsrWref_dataref_idtagr()rZrUrXr)batch_insert_seed_assetsds                   rxrcCst|}t||S)zHard-delete unhashed assets with no active references. This is a destructive operation intended for explicit cleanup. Only deletes assets where hash=None and all references are missing. Returns: Number of assets deleted )rr )rHunreferenced_idsr(r(r)cleanup_unreferenced_assetss rz)rG)rHrrIrJr0rrKrC)rHrrKr)# __future__rr^r` dataclassesrrtypingrrrsqlalchemy.ormrapp.assets.database.queriesr r r r r rrrrapp.assets.helpersr$app.assets.services.metadata_extractrrr*r-r7r<rCrxrzr(r(r(r)s,    ,      .