jr(ddlZddlZddlmZddlmZddlmZddlm Z m Z m Z ddl m Z ddlmZdd lmZmZd Zd efd Zd edeeeefd efdZd ed dfdZ d$dddddddeedeedeed eedeeeefdeeee fd eefdZd$deed dfdZd%deeded dfdZd&deedeed dfd Z d'deedeedeed eedeedeeee ff d!Z d$ddddddd"deedeedeed eedeedeeee ff d#ZdS)(N)proton)getenv)flags) HookManager LaunchHookInstrumentationHook)Hook)BaseMode)OptionalUnionrreturnctjjjj}t j|SN)tritonruntimedriveractiveget_current_targetbackend libproton#select_profiler_from_triton_backend)rs |/home/lighthouse/badge-speaker-benchmark/.benchmark-venv-community/lib64/python3.11/site-packages/triton/profiler/profile.py_select_backendrs/n#*==??GG  8 A AArmodec|dkr8tjjjj}|r|d|n|S|rt |ndS)Ninstrumentation:)rrrrrrstr)rrprefixs r _get_mode_strr#s]###&-@@BBJ%)5&!!4!!!v5 $3t999"$rc|dvr,ddg}|D]%}t|dtd|d&|dko0tjjjjdk}tjj j D]\}}|j }t|d|dkr7|r5tj |tjj jYttjj |}|Gtj|x}r&tj ||d dS) N) rocprofiler roctracerHIP_VISIBLE_DEVICESCUDA_VISIBLE_DEVICESz3Proton does not work when the environment variable zK is set on AMD GPUs. Please unset it and use `ROCR_VISIBLE_DEVICES` insteadcuptidTRITON_CUPTI_LIB_PATHr)r ValueErrorrrrrrarchknobsrknob_descriptorsitemskeysetenvcupti_lib_blackwell_dirgetattrtoenv) rhip_device_envsenvuse_blackwell_cuptiattrdescr1valenv_vals r _check_envr=sj...02HI"  Cc4  , [#[[[- "W,n1F1M1`1`1b1b1gkn1nl):@@BB 9 9 dh #t   $---2E- ##C)<)TUUU&,-t44C$l0055579L''WQZ888 9 9rshadowtreecontextdatarrhooknamerArBrCc,tjstjjjrdSdt_|tn|}|tn|}t||}t|tj |||||}t|trtj||n<|dkr"tjt#|n|t%d||dkr"tjt'|||S)ah Start profiling with the given name and backend. Usage: ```python proton.start("my_profile") # do something proton.finalize() ``` Args: name (str, optional): The name (with path) of the profiling session. If not provided, the default name is "~/proton.", where suffix is the default format according to the data type. For example, if data is "tree", the default name is "~/proton.hatchet". context (str, optional): The context to use for profiling. Available options are ["shadow", "python"]. Defaults to "shadow". data (str, optional): The data structure to use for profiling. Available options are ["tree", "trace"]. Defaults to "tree". backend (str, optional): The backend to use for profiling. Available options are [None, "cupti", "rocprofiler", "roctracer", "instrumentation"]. Defaults to None, which automatically selects the backend matching the current active runtime. On AMD GPUs, "rocprofiler" is preferred and will fall back to "roctracer" if rocprofiler-sdk is not available. mode (Union[str, BaseMode], optional): The "mode" to use for profiling, which is specific to the backend. Can be a string or an instance of BaseMode (or any subclass thereof). Defaults to None. For "cupti", available options are [None, "pcsampling", "periodic_flushing"]. For "rocprofiler", available options are [None, "periodic_flushing"]. For "roctracer", available options are [None, "periodic_flushing"]. For "instrumentation", available options are [None]. Each mode has a set of control knobs following with the mode name. For example, "periodic_flushing" mode has a knob: - format: The output format of the profiling results. Available options are ["hatchet", "hatchet_msgpack", "chrome_trace"]. Default is "hatchet". The can be set via `mode="periodic_flushing:format=chrome_trace"`. hook (Union[str, Hook], optional): The hook to use for profiling. You may pass either: - a string hook name, e.g. "triton" (kernel launch metadata), or - a custom Hook instance. Defaults to None. Returns: session (Optional[int]): The session ID of the profiling session, or None if profiling is disabled. NTrzUnsupported hook: r)r command_linerr.rdisable profiling_onDEFAULT_PROFILE_NAMErr#r=rstart isinstancer rregisterrr,r )rDrArBrrrCmode_strsessions rrJrJ4sl V\08tE#'<  TD#*?oGWd++HwodGT7HEEG$8T7++++   Z\\73333 6d66777###066@@@ NrrNctjr|dkrtdtj||t jdSt j|dS)z Activate the specified session. The profiling session will be active and data will be recorded. Args: session (int): The session ID of the profiling session. Defaults to None (all sessions) Returns: None rzEOnly one session can be activated when running from the command line.N)rrFr,ractivater activate_all)rNs rrPrPsi bgll`aaa!!!     7#####rFflushingctjr|dkrtdtj||t j|dSt j||dS)ap Stop the specified session. The profiling session's data will still be in the memory, but no more data will be recorded. Args: session (int): The session ID of the profiling session. Defaults to None (all sessions) flushing (bool): Whether to flush the profiling data before deactivating. Defaults to True. Returns: None rzGOnly one session can be deactivated when running from the command line.N)rrFr,r deactivaterdeactivate_all)rNrRs rrTrTsm dgllbccc7### *****Wh/////rr output_formatctj||"dt_t j|dStjr|dkrtdt j||dS)a Finalizes a profiling session. Flush and write the profiling data to the file specified by the session name. Args: session (int, optional): The session ID to finalize. If None, all sessions are finalized. Defaults to None. output_format (str, optional): The output format for the profiling results. Available options are ["hatchet", "hatchet_msgpack", "chrome_trace"]. Returns: None NFrzEOnly one session can be finalized when running from the command line.) r unregisterrrHr finalize_allrFr,finalize)rNrVs rrZrZsu7###"}-----   f'Q,,dee e7M22222rc^tjfd}|S)z Context manager for profiling. Internally use only. Args: See start() for the arguments. Returns: wrapper (function): The wrapped function. c`t  }|i|}t||S)Nr@)rJrT) argskwargsrNretrrArBfuncrCrrDs rwrapperz_profiling..wrappersFgD'PT[_```dD#F##7 r) functoolswraps)r`rDrArBrrrCras``````` r _profilingrds^&_T NrrDrArBrrrCc V| fd}|St|S)z Decorator for profiling. Usage: ```python @proton.profile def foo(): pass ``` Args: See start() for the arguments. Returns: decorator (function): The decorator function. Nc 0t|S)Nrerd)frrArBrCrrDs r decoratorzprofile..decorators#adG$PW^bimnnn nrrerh)r`rDrArBrrrCrjs `````` rprofilerkst6 | o o o o o o o o o o$T7w]ahlmmmmrr)NF)Nr )Nr>r?NNN) rbrtriton._C.libprotonrrtriton._C.libtritonrrhooksrrr hooks.hookr rr typingr r rIr!rr#r=intrJrPboolrTrZrdrkrrrts 333333&&&&&&??????????""""""""BBBBB %3%huS(]/C&D%%%%%9999994N& !+/'+NNN 3-Nc]N 3- N c] N 5h' ( N 5d# $Nc]NNNNb$$hsm$t$$$$,00 000000.33hsm38C=3RV33334% !'+ 3-c] 3-  c]  3-  5d# $< #n% !'+#n#n#n 3-#nc] #n 3- #n c] #n 3-#n 5d# $#n#n#n#n#n#nr