jц fUdZddlmZddlZddlmZddlmZddlZddlmZddl Z ddl Z ddl Z ddl Z ddl Z ddlmZddlZddlZddlZddlmZdd lmZdd lmZdd lmZdd lmZdd lmZddlmZddlmZddlm Z ddl!m"Z"ddl!m#Z#ddl$m%Z%edZ&dZ'dedZ(dfdZ)dgd Z*dhd(Z+Gd)d*eZ,Gd+d,Z-did0Z.did1Z/djd4Z0Gd5d6Z1Gd7d8e1Z2Gd9d:e1Z3Gd;de1Z5Gd?d@e1Z6GdAdBe1Z7GdCdDe1Z8GdEdFe1Z9GdGdHe1Z:GdIdJe1Z;GdKdLe1ZdO<dkdPZ?dldSZ@dmdWZAdndod[ZBdpd]ZCdqdaZDdqdbZEdrddZFdS)szfOptuna CLI module. If you want to add a new command, you also need to update the constant `_COMMANDS` ) annotationsN)ArgumentParser) Namespace)Enum)Any) _LazyImport) optuna_warn) CLIUsageError)ExperimentalWarning) BaseStorage)JournalFileStorage)JournalRedisStorage)JournalStorage) RDBStorage)JournalFileBackend)JournalRedisBackend) TrialStatezoptuna.study._dataframez%Y-%m-%d %H:%M:%S storage_url str | Nonereturnstrc||Stjd}|tdt|St d)NOPTUNA_STORAGEzSpecifying the storage url via 'OPTUNA_STORAGE' environment variable is an experimental feature. The interface can change in the future.zStorage URL is not specified.)osenvirongetr r r )r env_storages m/home/lighthouse/badge-speaker-benchmark/.benchmark-venv-community/lib/python3.11/site-packages/optuna/cli.py_check_storage_urlr*sZ*..!122K S     7 8 88 storage_classr c&t|}|r|tjkrtt|S|tjkrtt |S|t jkrtt |S|t jkrtt |S|tjkrt|Std| drtt|Stj |rtt |S t|S#tjj$rtdwxYw)NzUnsupported storage classredisz.Failed to guess storage class from storage_url)rr__name__rrrr rr startswithrpathisfile sqlalchemyexc ArgumentError)rr!s r _get_storager+9s|$[11K 9 /8 8 8!"5k"B"BCC C /8 8 8!"5k"B"BCC C .7 7 7!"4["A"ABB B .7 7 7!"4["A"ABB B J/ / /k** *7888g&&@1+>>??? w~~k""?0==>>>N+&&& > 'NNNLMMMNs E,,$Fvaluerc|t|ttfr|St|tjr|t St|t rt d|DSt|trtd|DSt|trd| DSt|S)Nc34K|]}t|VdSN _format_value.0vs r z _format_value..Ys*44M!$$444444r c34K|]}t|VdSr/r0r2s rr5z _format_value..[s*55!]1%%555555r cNi|]"\}}t|t|#Sr0)r3kr4s r z!_format_value..]s.MMMtq! a  -"2"2MMMr ) isinstanceintfloatdatetimestrftime_DATETIME_FORMATlisttupledictitemsr)r,s rr1r1Rs } 53,77} E8, - - ~~./// E4 44e444444 E5 ! !55u555555 E4 MMu{{}}MMMM5zzr records list[dict[tuple[str, str], Any]]columnslist[tuple[str, str]]flattenbool&tuple[list[dict[str, Any]], list[str]]c g}g}|r||D]̊ ddkr'| dd d5t fd|Drad}|D])} |vr#t|t| }*t |D]"}| dd|#| d|D]}i}|D] |vrt | } ddkr| | dd d<?t fd|Dr&t | D]\}} | | dd|<| | d<||n=|D]' d|vr| d(|D]}d|D} |D] |vrt | } t dtr| dikr g| d<| dxxdgt ddzt| dz dzz cc<| | d d< ddkr| | d d<| | d<|| ||fS)Nr_c3vK|]3}t|ttfV4dSr/r;rrArBr3recordcolumns rr5z#_convert_to_dict..ks=YYvZ 6 2 2T5MBBYYYYYYr c3vK|]3}t|ttfV4dSr/rQrRs rr5z#_convert_to_dict..|s=]]6FJJv$6$6u FF]]]]]]r ci|]}|iSr8r8)r3 column_names rr:z$_convert_to_dict..s$O$O$O["$O$O$Or ) appendanymaxlenranger1 enumerater;r<) rErGrIheaderret max_lengthrSirowr,r4attrsrTs @r_convert_to_dictrdbsF C0 ) )FayB 88VAY889999YYYYQXYYYYY ) %JJF''%(S5H5H%I%I z**66AMMVAY"4"4"4"455556 fQi((((  FC! 0 0''%fVn55!9??6;C6!922vay2233]]]]U\]]]]]0 )% 0 044123vay..1..//4+0C6!9'' JJsOOOO  ) )Fay&& fQi(((  F$O$O$O$O$OE! - -''%fVn55fQi-- -VAY'2--+-fQi(&)$$$VAY]SvVWyIYEZEZ5Z\]1^1^(^^$$$27E&)$VAY//AY"__27E&)$VAY//',E&)$$ JJu     ;r ceZdZdZdZdZdS) ValueTyperrMN)r$ __module__ __qualname__NONENUMERICSTRINGr8r rrfrfs DG FFFr rfc.eZdZddZddZdd Zdd ZdS) CellValuer,rrNonec||_|tj|_dSt |t t frtj|_dStj|_dSr/) r,rfrj value_typer;r<r=rkrl)selfr,s r__init__zCellValue.__init__sM ='nDOOO U| , , /'/DOOO'.DOOOr rct|jtjr|jtSt |jSr/)r;r,r>r?r@rrrs r__str__zCellValue.__str__s> dj("3 4 4 #:&&'788 8tz?? "r r<cDtt|jSr/)r[rr,rus rwidthzCellValue.widths3tz??###r rqrfrxc~t|j}|jd|zS|tjkr|d|S|d|S)N ><)rr,rfrk)rrrqrxr,s r get_stringzCellValue.get_stringsWDJ : ;  9, , ,&e&&& &&e&&& &r N)r,rrro)rrrr<)rqrfrxr<rr)r$rhrirsrvrxr}r8r rrnrnsd////#### $$$$''''''r rnlist[dict[str, Any]]r^ list[str]cg}|D]p}g}|D]A}|||t||ndB|d|qd|S)NrNrz )rXrrjoin)rEr^valuesrSrbrWs r _dump_valuers F%%! ` `K JJ6::k3J3J3Vs6+.///\^ _ _ _ _ chhsmm$$$$ 99V  r c g}|D]S}g}|D]7}|t||8||Td}d}d|D}tt |D]-fd|D} t j} | D]} | t jkr t j} t |dkrt |} nz_dump_table..s%%%13%%%r c*g|]}|jSr8)rqr3rbrTs rrz_dump_table..s >>>#s6{->>>r rc3LK|]}|VdSr/)rxrs rr5z_dump_table..s34Y4YSS[5F5F5H5H4Y4Y4Y4Y4Y4Yr -rgrzr{z |r|rNr) rXrnrr\r[rfrkrlrZr]r})rEr^rowsrSrbrW separator header_string rows_string value_typesrqt max_widthrar_ row_stringrTs @r _dump_tablersy D! ; ;K JJyK!8!899 : : : : CIM%%%%%KF $$YY>>>>>>> &  . .AI$$$&- t99>>F6N++IICv//4Y4Y4Y4YTX4Y4Y4Y1Y1YZZISIM*S00 * * * @@)@@@@@ @MM @@)@@@@@ @Moo Y YFAs NNNcCK$:$::y$Q$QQTXX XNNNN Y C9t C=4 C9t C!!!  zD  9t C Jr =list[dict[tuple[str, str], Any]] | dict[tuple[str, str], Any] output_formatct|trt|||\}}nt|g||\}}|dkr"t||S|dkr"t ||S|dkrgt|tr&t j|St j|dS|dkrgt|tr&tj |Stj |dStd|d)Nr,tablejsonryamlz"Optuna CLI does not supported the z format.) r;rArdrstriprrdumpsr safe_dumpr )rErGrrIrr^s r_format_outputrs_ '4  G)'7GDD)7)WgFF66**00222 ' ! !66**00222 & gt $ $ 1:f%%++-- -:fQi((..00 0 & gt $ $ 5>&))//11 1>&),,2244 4XXXXYYYr c*eZdZdZd dZddZdd Zd S) _BaseCommandzBase class for commands. Note that command classes are not intended to be called by library users. They are exclusively used within this file to manage Optuna CLI commands. rrocXtjt|_dSr/)optunalogging get_loggerr$loggerrus rrsz_BaseCommand.__init__sn//99 r parserrcdS)zAdd arguments required for each command. Args: parser: `ArgumentParser` object to add arguments Nr8rrrs r add_argumentsz_BaseCommand.add_argumentss  r parsed_argsrr<ct)aDefine action if the command is called. Args: parsed_args: `Namespace` object including arguments specified by user. Returns: Running status of the action. 0 if this method finishes normally, otherwise 1. )NotImplementedError)rrrs r take_actionz_BaseCommand.take_action$s "!r N)rrorrrrorrrr<)r$rhri__doc__rsrrr8r rrrsZ ::::     " " " " " "r rc"eZdZdZd dZd d Zd S) _CreateStudyzCreate a new study.rrrroc|ddd|ddtdd|dd d d |d tdddddS)N --study-namez?A human-readable name of a study to distinguish it from others.defaulthelpz --direction)minimizemaximizeznSet direction of optimization to a new study. Set 'minimize' for minimization and 'maximize' for maximization.)rtypechoicesrz--skip-if-existsF store_truezgIf specified, the creation of the study is skipped without any error when the study name is duplicated.ractionrz --directionszSet directions of optimization to a new study. Put whitespace between directions. Each direction should be either "minimize" or "maximize".r)rrrrnargs add_argumentrrs rrz_CreateStudy.add_arguments6s R     ,@      C      ,0  r rrr<ct|j|j}tj||j|j|j|jj}t|dS)N)storage study_name direction directionsload_if_existsr) r+rr!r create_studyrrrskip_if_existsprint)rrrrrs rrz_CreateStudy.take_actionVsf{2K4MNN("-!+"-&5      jqr Nrrr$rhrirrrr8r rrr3sC    @      r rc"eZdZdZd dZd d Zd S) _DeleteStudyzDelete a specified study.rrrroc6|ddddS)Nrz The name of the study to delete.rrrs rrz_DeleteStudy.add_argumentsfs$ND?abbbbbr rrr<ct|j|j}||j}||dS)Nr)r+rr!get_study_id_from_namer delete_study)rrrrstudy_ids rrz_DeleteStudy.take_actionisF{2K4MNN11+2HIIX&&&qr Nrrrr8r rrrcsF##ccccr rc"eZdZdZd dZd d Zd S)_StudySetUserAttributez Set a user attribute to a study.rrrroc|ddd|dddd|ddd dS) NrTz3The name of the study to set the user attribute to.)requiredrz--keyz-kzKey of the user attribute.z--valuezValue to be set.rrs rrz$_StudySetUserAttribute.add_argumentsssj F    GTD?[\\\I;MNNNNNr rrr<ct|j|j}tj||j}||j|j|j ddS)NrrzAttribute successfully written.r) r+rr!r load_studyr set_user_attrkeyr,rinfo)rrrrstudys rrz"_StudySetUserAttribute.take_action|sf{2K4MNN!'k>TUUU KO[->??? :;;;qr Nrrrr8r rrrpsF**OOOOr rc"eZdZdZd dZd d Zd S) _StudyNamesz1Get all study names stored in a specified storagerrrrocF|ddtddddS)N-f--formatr,rrrr,Output format.rrrrrrs rrz_StudyNames.add_argumentss;  6!      r rrr<ct|j|j}tj|}g}d}|D]}|||it t||g|jddS)NnamerNF)rIr) r+rr!rget_all_study_namesrXrrformat)rrrrall_study_namesrE record_keyrs rrz_StudyNames.take_actions{2K4MNN 4W==! ) 5 5J NNJ 3 4 4 4 4 nWzlK4FPUVVVWWWqr Nrrrr8r rrrsB;;    r rc*eZdZdZgdZd dZdd Zd S)_StudieszShow a list of studies.)rrrNn_trialsrNdatetime_startrNrrrrocx|ddtddd|ddd d dS) Nrrrrrr --flattenFrz*Flatten nested columns such as directions.rrrs rrz_Studies.add_argumentssf  6!      =      r rrr<c<t|j|j}tj|d}g}|D]}|j|jtnd}i}|j|d<td|j D|d<|j |d<||d<|j |d<| |td |Dr|j dt!t#||j|j|jd S) NF)include_best_trialrc3$K|] }|jV dSr/)r)r3ds rr5z'_Studies.take_action..s$-K-Kaf-K-K-K-K-K-Kr rrr user_attrsrNc3.K|]}|dikVdS)rNr8)r3rs rr5z'_Studies.take_action..s-< > > 0+2DkFY     qr Nrr)r$rhrirrrrr8r rrrsT!!    r rc"eZdZdZd dZd d Zd S)_TrialszShow a list of trials.rrrroc|dtdd|ddtddd |d d d ddS)NrTz,The name of the study which includes trials.rrrrrrrrrrFr5Flatten nested columns such as params and user_attrs.rrrs rrz_Trials.add_arguments ?      6!      H      r rrr<chtdtt|j|j}t j||j}d|sdnddddd d d f}t ||\}}tt|||j |jd S) NzP'trials' is an experimental CLI command. The interface can change in the future.rnumberr,rrdatetime_completedurationparamsrstater)r r r+rr!rrr_is_multi_objective _dataframe$_create_records_and_aggregate_columnrrrrIrrrrrrcrErGs rrz_Trials.take_actions ^    {2K4MNN!'k>TUUU  4466 DGGH        &JJ5RWXX nWg{/A;CVWWXXXqr Nrrrr8r rrrsB      ,r rc"eZdZdZd dZd d Zd S) _BestTrialzShow the best trial.rrrroc|dtdd|ddtddd |d d d ddS)NrTz,The name of the study to get the best trial.r rrrrrrrFrr rrrs rrz_BestTrial.add_arguments r r rrr<ctdtt|j|j}t j||j}d|sdnddddd d d f}t ||\}}tt||j j||j|jd S) NzT'best-trial' is an experimental CLI command. The interface can change in the future.rrr,rrrrrrrr)r r r+rr!rrrrrrrr best_trialrrrIrs rrz_BestTrial.take_action!s b    {2K4MNN!'k>TUUU  4466 DGGH        &JJ5RWXX (/0';;M{Ob     qr Nrrrr8r rrrsB    ,r rc"eZdZdZd dZd d Zd S) _BestTrialsz2Show a list of trials located at the Pareto front.rrrroc|dtdd|ddtddd |d d d ddS)NrTzJThe name of the study to get the best trials (trials at the Pareto front).r rrrrrrrFrr rrrs rrz_BestTrials.add_arguments@s ]      6!      H      r rrr<ctdtt|j|j}t j||j}d|jDd| sdndddd d d d f}t ||\}}ttfd |}tt|||j|jdS)NzU'best-trials' is an experimental CLI command. The interface can change in the future.rcg|] }|j Sr8)r)r3trials rrz+_BestTrials.take_action.._sCCCu|CCCr rr,rrrrrrrc|dvS)NrrNr8)rS best_trialss rz)_BestTrials.take_action..ls&2HK2Wr r)r r r+rr!rrrr$rrrrAfilterrrrrI) rrrrrrcrErG best_recordsr$s @rrz_BestTrials.take_actionVs     {2K4MNN!'k>TUUUCC1BCCC  4466 DGGH        &JJ5RWXXF#W#W#W#WY`aabb  n\7K4F H[\\]]]qr Nrrrr8r rrr=sB<<    ,r rceZdZdZddZdS) _StorageUpgradez%Upgrade the schema of an RDB storage.rrrr<c2t|j} t|dd}n5#tjj$r|jdYdSwxYw|}| }| }||kr|j dn\||vrI|j d| |j dntdd S) NT)skip_compatibility_checkskip_table_creationzInvalid RDBStorage URL.rMzThis storage is up-to-date.z3Upgrading the storage schema to the latest version.z!Completed to upgrade the storage.zYour optuna version seems outdated against the storage version. Please try updating optuna to the latest version by `$ pip install -U optuna`.r)rrrr(r)r*rerrorget_current_versionget_head_versionget_all_versionsrupgrader )rrrrrcurrent_version head_versionknown_versionss rrz_StorageUpgrade.take_actionts9()<==   dPTGG~+    K  7 8 8 811 "5577//11  1133 l * * K  : ; ; ; ;  . . K  R S S S OO    K  @ A A A A -    qs).AANr)r$rhrirrr8r rr)r)qs.//r r)c"eZdZdZd dZd d Zd S)_Askz*Create a new trial and suggest parameters.rrrroc`|dtd|dtd|dtd|dtd |d d td d d|dddddS)NrName of study.rrz --samplerz'Class name of sampler object to create.z--sampler-kwargsz8Sampler object initialization keyword arguments as JSON.z--search-spaceztSearch space as JSON. Keys are names and values are outputs from :func:`~optuna.distributions.distribution_to_json`.rrrrrrrFrz&Flatten nested columns such as params.rrrs rrz_Ask.add_argumentssN;KLLLKc8abbb K     F       6!      9      r rrr<cVtdtt|j|j}||jdd}|jP|jtj |j}ni}ttj |j}|di|}||d<n|jtd|j6dtj |jD}ni} tj|d|d|d }n#t$$rt%d wxYw|| } |jd | jd | jdd| ji} dg} t1| jdkr"|jsi| d<| dn=| jD]#\} } | | d| f<| d| f$t7t9| | |j|jdS)NzM'ask' is an experimental CLI command. The interface can change in the future.T)rrrsamplerzm`--sampler_kwargs` is set without `--sampler`. Please specify `--sampler` as well or omit `--sampler-kwargs`.cxi|]7\}}|tjtj|8Sr8)r distributionsjson_to_distributionrr)r3rdists rr:z$_Ask.take_action..sID$f*?? 4@P@PQQr rr)rrr;zImplicit study creation within the 'ask' command was dropped in Optuna v4.0.0. Please use the 'create-study' command beforehand.)fixed_distributionsz Asked trial z with parameters .r#r)rrNrr8)r r r+rr!rr;sampler_kwargsrloadsgetattrrsamplers ValueError search_spacerDrrKeyErroraskrrrrr[rIrXrrr)rrrrcreate_study_kwargsrB sampler_clsr;rGrr!rSrG param_name param_values rrz_Ask.take_actions [    {2K4MNN%0"     *)5!%K,F!G!G!#!&/;3FGGK!k33N33G-4  * *)5 8  # /"&*[-E"F"F"L"L"N"NLL L %.|<+I6+// ::EE    D    l ;; V VVu|VVVWWW. " NN> * * * *+0<+=+=+?+? 7 7' K1<*-.*56666 nVWk.@+BUVVWWWqs (6DD9Nrrrr8r rr6r6sH44    >DDDDDDr r6c"eZdZdZd dZd d Zd S)_Tellz5Finish a trial, which was created by the ask command.rrrroc$|dtd|dtd|dtdd |d td d |dddddS)Nrr8r9z--trial-numberz Trial number.z--valuesrzObjective values.)rrrz--statez Trial state.)completeprunedfail)rrrz--skip-if-finishedFrzSIf specified, tell is skipped without any error when the trial is already finished.r)rrr<r=rs rrz_Tell.add_argumentssN;KLLL,3_MMMJU#DWXXX 2           r rrr<c tdtt|j|j}t j||j}|j%t|j }nd}|j }|j }| ||||j|jd|d|d|ddS) NzN'tell' is an experimental CLI command. The interface can change in the future.r)r!rrskip_if_finishedz Told trial z with values z and state rAr)r r r+rr!rrrrrupper trial_numberrtellrUrr)rrrrrrrWrs rrz_Tell.take_action s \    {2K4MNN!"-      ('1+2C2I2I2K2K'LEEE"/ # (9     ]|]]&]]UZ]]]^^^qr Nrrrr8r rrOrOsB??    $r rO) z create-studyz delete-studyzstudy set-user-attrz study-namesstudiestrialsz best-trialz best-trialszstorage upgraderIrXzdict[str, type[_BaseCommand]] _COMMANDSctjtjtjg}tjt jg}|||zvr|St jd|dt|ddd)NzInvalid choice: z (choose from rM)) rr$rrr rargparseArgumentTypeErrorr)r,rdeprecated_choicess r:_parse_storage_class_without_suggesting_deprecated_choicesrb=s#$G #$ ,,,,  $F5FFWad1CFFF  r rrcj|ddd|dddt|}|ddd d d d |dddd dd|dddd|dddd|S)Nz --storagezbDB URL. (e.g. sqlite:///example.db) Also can be specified via OPTUNA_STORAGE environment variable.rz--storage-classz,Storage class hint (e.g. JournalFileBackend))rrrz-vz --verbosecount verbose_levelrMz.Increase verbosity of output. Can be repeated.)rdestrrz-qz--quiet store_constrz+Suppress output except warnings and errors.)rrfconstrz --log-filestorez2Specify a file to log output. Disabled by default.)rrrz--debugFrzShow tracebacks on errors.r)rrbadd_mutually_exclusive_group)r verbose_groups r_add_common_argumentsrlNs&  M   ; G  7799M   =    :   A    )  Mr main_parser parent_parserdict[str, ArgumentParser]c}i}tD]o\}}|}|||gt j|}||||j|||<pd fd }|dd ||S) N)parentsr)handlerargsrrroc0dSr/) print_help)rsrms r _print_helpz"_add_commands.._print_helps     r rzShow help message and exit.)rrsrrro) add_subparsersr[rD add_parserinspectgetdocr set_defaultsr) rmrn subparserscommand_name_to_subparser command_name command_typecommand subparserrvs ` r _add_commandsr}s ++--J "&/oo&7&7<<" l,..)) =/|8T8T*   i(((w':;;;2;!,//!!!!!!&'DEERRS %$r rN description0tuple[ArgumentParser, dict[str, ArgumentParser]]ctd}t|}t||g}|dddtjt ||}||fS)NF)add_help)rrqz --versionversionzoptuna )rr)rrlrr __version__r)rrnrmr~s r _get_parserrsx#E222M)-88M [=/RRRK[DbfN`DbDbccc -k= I I 1 11r argvcFt|dkr |ddndg}tt|D]c}t||dzD]M}d|||dz}|tvr"|d|||dzdz}|g|zccSNd|S)NrMrrgrz)r[r\rr[)rrajcommand_candidateoptionss r_preprocess_argvrs4yy1}}4886(D 3t99  55q!a% 5 5A #a!a%i 9 9  I--rr(T!a%'']2)*W444444. 5 Kr rsrroc(tj}|tjtjt j}tjtjtjd |j tj}||| tj ||tj|dS)N)rrMrg)r getLoggersetLevelDEBUG StreamHandlersysstderrWARNINGINFOrre setFormatterrcreate_default_formatter addHandler set_verbosity)rs root_loggerstream_handler logging_levels r_set_verbosityrs#%%K'''*3:66N ? < = c$ gm,,  M*** G G I IJJJ>*** N  /////r c<|jdStj}|tjtj|j}|tj| |dS)N)filename) log_filerrrr FileHandlerrrrr)rsr file_handlers r _set_log_filers }#%%K'''&LfnEEGGHHH<(((((r r<ct\}}tj}t|}||}t |t |tjd} | |S#t$r]}|j r| |n5| |||dYd}~dSd}~wt$rNd|dd}| d|d|YdSwxYw)NrrrMrz'z/' is not an optuna command. see 'optuna --help')rrrr parse_argsrrrrrrr debug exceptionr-ruAttributeErrorr)rmr~rpreprocessed_argvrsreargv_strs rmainrs]-8]]*K* 8D(..  ! !"3 4 4D4$  x ( (F||D!!!  : I   Q     LLOOO &&7&: ; F F H H Hqqqqq 88DH%% RRRRSSS   qq s 5B EAC,,AEE)rrrr)rrr!rrr )r,rrr)rErFrGrHrIrJrrK)rErr^rrr) rErrGrHrrrIrJrr)r,rrr)rrrr)rmrrnrrro)rN)rrrr)rrrrrwr~)Gr __future__rr_rrr>enumrrzrrrrtypingrsqlalchemy.excr(rroptuna._importsroptuna._warningsr optuna.exceptionsr r optuna.storagesr r rrroptuna.storages.journalrr optuna.trialrrr@rr+r1rdrfrnrrrrrrrrrrrrr)r6rOr[__annotations__rbrlrrrrrrr8r rrs#"""""######   ''''''((((((++++++111111''''''......//////******&&&&&&666666777777######[2 3 3 & 9 9 9 9NNNN2     7777t '''''''':    %%%%PZZZZ:""""""""D-----<---`     <   \.,044444|444n/////l///d22222222j11111,111hl