o j6h@sdZddlmZddlZddlmZmZmZddlm Z ddl m Z ddl m Z ddl m Z Gd d d eZGd d d ejZGd ddee jZGdddee jZd%ddZd&ddZd'ddZd(dd Zd)d#d$ZdS)*z2Utilities for working with post-processing tokens.) annotationsN)AnyCallableSequence)py_utils) llm_function)llmfn_output_row)llmfn_post_processc@seZdZdZdS)PostProcessParseErrorz,An error parsing the post-processing tokens.N)__name__ __module__ __qualname____doc__rr~/var/www/html/chefvision.cloud.itp360.com/venv/lib/python3.10/site-packages/google/generativeai/notebook/post_process_utils.pyr sr c@s0eZdZdZejd ddZejd dd Zd S) ParsedPostProcessExprz:A post-processing expression parsed from the command line.returnstrcCdS)z$Returns the name of this expression.Nrselfrrrname"zParsedPostProcessExpr.namellm_fnllm_function.LLMFunctioncCr)zEAdds this parsed expression to `llm_fn` as a post-processing command.Nrrrrrradd_to_llm_function&rz)ParsedPostProcessExpr.add_to_llm_functionNrrrrrr)r r r rabcabstractmethodrrrrrrrs  rc@8eZdZdZdddZdd d ZdddZdddZdS)_ParsedPostProcessAddExprzEAn expression that returns the value of a new column to add to a row.rrfnCallable[[str], Any]cC||_||_dS)aConstructor. Args: name: The name of the expression. The name of the new column will be derived from this. fn: A function that takes the result of a row and returns a new value to add as a new column in the row. N_name_fnrrr#rrr__init__0s z"_ParsedPostProcessAddExpr.__init__rcC|jSNr'rrrrr<z_ParsedPostProcessAddExpr.namerows-Sequence[llmfn_output_row.LLMFnOutputRowView] Sequence[Any]cfdd|DS)Ncg|] }|qSrr( result_value.0rowrrr @z6_ParsedPostProcessAddExpr.__call__..rrr/rrr__call__?z"_ParsedPostProcessAddExpr.__call__rrcC|j|j|dSNrr#)add_post_process_add_fnr'rrrrrBz-_ParsedPostProcessAddExpr.add_to_llm_functionN)rrr#r$r)r/r0rr1rr r r rr*rr<rrrrrr"+s   r"c@r!)_ParsedPostProcessReplaceExprz:An expression that returns the new result value for a row.rrr#Callable[[str], str]cCr%)zConstructor. Args: name: The name of the expression. fn: A function that takes the result of a row and returns the new result. Nr&r)rrrr*Ks z&_ParsedPostProcessReplaceExpr.__init__rcCr+r,r-rrrrrUr.z"_ParsedPostProcessReplaceExpr.namer/r0 Sequence[str]cr2)Ncr3rr4r6rrrr9Yr:z:_ParsedPostProcessReplaceExpr.__call__..rr;rrrr<Xr=z&_ParsedPostProcessReplaceExpr.__call__rrcCr>r?)add_post_process_replace_fnr'rrrrr[rBz1_ParsedPostProcessReplaceExpr.add_to_llm_functionN)rrr#rEr)r/r0rrFrrCrrrrrDFs   rDr#r$cCt|j|dSr?)r"r r#rrrpost_process_add_fn`rJrEcCrHr?)rDr rIrrrpost_process_replace_fndrKrLtokensrFrNonecCs$|stdt|dkrtddS)Nz,Cannot have empty post-processing expressionz3Post-processing expression should be a single token)r len)rMrrr'validate_one_post_processing_expressionhs  rQtuple[str, Any]c Csvt||dd}t}t|D] \}}t|}||vr/tdd|d|d||}qd||fS)z)Returns name and the resolved expression.r.zUnable to resolve "{}"NrO ) rQsplitrget_main_module enumeratevarsr formatjoin)rM token_partscurrent_modulepart_numpartcurrent_module_varsrrr'_resolve_one_post_processing_expressionqs r`Sequence[Sequence[str]]Sequence[ParsedPostProcessExpr]cCs^g}|D](}t|\}}t|tr||qt|tr&|t||dqtd||S)a Resolves post-processing tokens into ParsedPostProcessExprs. E.g. Given [["add_length"], ["to_upper"]] as input, this function will return a sequence of ParsedPostProcessExprs that will execute add_length() and to_upper() on each entry of the LLM output as post-processing operations. Raises: PostProcessParseError: An error parsing or resolving the tokens. Args: tokens: A sequence of post-processing tokens after splitting. Returns: A sequence of ParsedPostProcessExprs. r@z{} is not callable)r` isinstancerappendrr"r rY)rMresults expression expr_name expr_valuerrrresolve_post_processing_tokenss    ri)r#r$)r#rE)rMrFrrN)rMrFrrR)rMrarrb)r __future__rrtypingrrrgoogle.generativeai.notebookr google.generativeai.notebook.librrr RuntimeErrorr ABCrLLMFnPostProcessBatchAddFnr"LLMFnPostProcessBatchReplaceFnrDrJrLrQr`rirrrrs*