ZiGddlZddlmZmZmZddlmZ ddlZejZ n #dZ YnxYwdZ dZ dZ GddZ dS) N)UnionOptionalLiteral) TavilyClientc  d}|jD]}|d|jkr|ddkrtd|jdd}|ddD]g}|d |jkr|dd krtd |jd |d dkr!td |jd|d dd}|std |jdd}|std|jddS)aA Check that the index specified by the parameters exists and is a valid vector search index. Raises: ValueError: If the index does not exist, is not of type 'vectorSearch', or if the embeddings field does not exist, is not of type 'vector', or has similarity other than 'cosine'. Fnametype vectorSearchzIndex 'z+' exists but is not of type 'vectorSearch'.latestDefinitionfieldspathvectorzField 'z%' exists but is not of type 'vector'. similaritycosinez' exists but has similarity 'z' instead of 'cosine'.Tz+' does not exist in index '{client.index}'.z' does not exist.N) collectionlist_search_indexesindex ValueErrorembeddings_field)client index_existsr field_existsfields W/root/projects/butler/venv/lib/python3.11/site-packages/tavily/hybrid_rag/hybrid_rag.py_validate_indexr sL"6688 =FL ( (  =N * */v|///00 0 -.x8  EV} 777V}(( "@6+B"@"@"@AAA|$00 "\6+B"\"\05l0C"\"\"\]]] L  87v'>77788 8 DB6<BBBCCCDDcFtd||jS)Nzembed-english-v3.0)modeltexts input_type)coembed embeddings)rr s r _cohere_embedr$5s+ 88"    rcztd|dD|}fd|jDS)Nzrerank-english-v3.0cg|] }|d Scontent).0docs r z"_cohere_rerank..>s#H#H#HsC N#H#H#Hr)rquery documentstop_nc>g|]}|jd|jizS)score)rrelevance_score)r*resultr.s rr,z"_cohere_rerank..@s=     &,7F,B"CC   r)r!rerankresults)r-r.r/responses ` r_cohere_rerankr7<sdyy4E#H#Hi#H#H#HPUWWH    &   rc|eZdZ ddeedfdeddeded ed eed eefd Z ddZ dS)TavilyHybridClientr#r(Napi_key db_providermongodbrr content_fieldembedding_functionranking_functionc t||_|dkrtd||_||_||_||_|tn||_|tn||_ t|dS)a A client for performing hybrid RAG using both the Tavily API and a local database collection. Parameters: api_key (str): The Tavily API key. If this is set to None, it will be loaded from the environment variable TAVILY_API_KEY. db_provider (str): The database provider. Currently only 'mongodb' is supported. collection (str): The name of the collection in the database that will be used for local search. index (str): The name of the collection's vector search index. embeddings_field (str): The name of the field in the collection that contains the embeddings. content_field (str): The name of the field in the collection that contains the content. embedding_function (callable): If provided, this function will be used to generate embeddings for the search query and documents. ranking_function (callable): If provided, this function will be used to rerank the combined results. r<z;Only MongoDB is currently supported as a database provider.N) rtavilyrrrrr=r$r>r7r?r) selfr:r;rrrr=r>r?s r__init__zTavilyHybridClient.__init__Fs2#7++ ) # #Z[[ [$ 0*3E3M--Se2B2JP`r Fc j||}||}||gdd}t|jd|j|j||dz|diddd|jd d id d ig}|dkr|jj|fd |i|d} ng} d| D} || z} t| dkrgS| || |} t| |kr | d|} |dkr|dkrg} |d| Dd} t| D]h\}}| ||d<|dkr0| |j|d|j|diF||}|r| |i|j | | S)au Return results for the given query from both the tavily API (foreign) and the specified mongo collection (local). Parameters: query (str): The query to search for. max_results (int): The maximum number of results to return. max_local (int): The maximum number of local results to return. max_foreign (int): The maximum number of foreign results to return. save_foreign (bool or function): Whether to save the foreign results in the collection. If a function is provided, it will be used to transform the foreign results before saving. N search_queryrz $vectorSearch)rr queryVector numCandidateslimitz$project$z$metavectorSearchScorelocal)_idr(r1origin max_resultsr5c2g|]}|d|dddS)r(r1foreign)r(r1rOr)r*r3s rr,z-TavilyHybridClient.search..sC% % %  "),#  % % % rFcg|] }|d Sr'r)rSs rr,z-TavilyHybridClient.search..s1b1b1b&2C1b1b1brsearch_documentr#Tr()r>listr aggregaterrr=rAsearchlenr? enumerateappend insert_many)rBr-rP max_local max_foreign save_foreignkwargsquery_embeddings local_resultsforeign_resultsprojected_foreign_resultscombined_resultsr.r#ir3s rrXzTavilyHybridClient.searchns|  #I  %K22E7NKKANT_66!Z 1#3%.]& "" 74#577!4&  8     . ??0dk0ZZKZSYZZ[deOO O% % * % % % !)+DD  A % %I 008H+VV  ; . ./  =  ??|u44I001b1bRa1b1b1bduvvJ&77 1 1 6'1!}|$4''$$*F9,=-vl/C& *\&11F1!((000 O ' ' 2 2 2r)r#r(NN)rDNNF) __name__ __module__ __qualname__rstrrrcallablerCrXr)rrr9r9Es%1!*5937&&39%&!+&  & " &&!) 2&'x0&&&&PIM!_ _ _ _ _ _ rr9)ostypingrrrrArcohereClientr!rr$r7r9r)rrrps ++++++++++MMM BB BBB'D'D'DRH H H H H H H H H H s*0