CoiCdZddlmZmZddlmZmZmZmZm Z ddl m Z ddl m Z ddlmZddlmZddlmZdd lmZmZdd lmZmZmZmZmZdd lmZeeZ Gd d Z!dS)zy Data synchronization orchestration service. Coordinates Garmin API data fetching, storage, and incremental sync logic. )date timedelta)ListDictAnyOptionalTuple)Path)config)GarminHealthClient) HealthStorage)HealthRepository) SyncErrorGarminAPIError) parse_date date_rangesplit_date_range get_yesterday format_date) setup_loggerceZdZdZ ddeedeedeeddfdZddZ dd e d e d e de fd Z dd e de de d e dee eff dZ dde de d e dee effdZ dde de deee d e dee ee efff dZ ddeee dee dee ee efffdZddejfde dee deee dedee ee efff dZdee effdZdS)HealthDataSyncz6Service for orchestrating health data synchronization.Nclientstoragereporeturnc|p t|_|p t|_|p t |_dS)a Initialize sync service. Args: client: Optional Garmin client (creates new if not provided) storage: Optional storage service (creates new if not provided) repo: Optional repository (creates new if not provided) N)r rr rrr)selfrrrs 2/root/projects/butler/health/services/data_sync.py__init__zHealthDataSync.__init__s>4 2 4 4 1-// .,.. ctd|jtddS)zpAuthenticate with Garmin Connect. Raises: GarminAuthError: If authentication fails zAuthenticating with Garmin...zAuthentication successfulN)loggerinfor authenticate)rs rr%zHealthDataSync.authenticate0sD  3444   """ /00000r!F metric_type target_dateforcec |s>|j||r#td|d|ddSt |jd|d}|std|dS ||}|s"td|d |dS|j||td |d|d S#t$r)}t d |d|d |d}~wt$r.}t d|d|d |Yd}~dSd}~wwxYw)a:Sync a single daily metric for a specific date. Args: metric_type: Type of metric to sync target_date: Date to sync force: If True, re-sync even if data already exists Returns: True if data was synced, False if skipped or no data available z Skipping z for  (already synced)Ffetch_Nz!No fetch method for metric type: zNo z data available for u ✓ Synced TzAPI error syncing : zError syncing ) r metric_existsr#debuggetattrrwarningsave_daily_metricr$rerror Exception)rr&r'r( fetch_methoddataes rsync_daily_metricz HealthDataSync.sync_daily_metric:s 33KMM  LLU[UU{UUU V V V5t{,B[,B,BDII   NNL{LL M M M5 < ,,D  Q;QQKQQRRRu L * *4 = = = KKEkEE EE F F F4    LLRkRR RRqRR S S S     LLN+NNKNN1NN O O O55555 s*<-C(+;C(( E2$D E##E  E start_dateend_datec td|d|d|d||z jdzd dddd}t||D]} |||| r|d xxdz cc<n|d xxdz cc<=#t $r:}td |d ||dxxdz cc<Yd}~|d}~wwxYwt|d|d d|d d|dd|S)a>Sync a daily metric for a date range. Args: metric_type: Type of metric to sync start_date: Start date (inclusive) end_date: End date (inclusive) force: If True, re-sync existing data Returns: Statistics dictionary with sync counts Syncing z from  to  (z days)rsyncedskippederrorsr(r@rAz API error on r,rBNz sync complete: synced, skipped,  errors)r#r$daysrr7rr2)rr&r8r9r(stats current_dater6s rsync_daily_metrics_rangez'HealthDataSync.sync_daily_metrics_rangefs$   9{ 9 9* 9 9( 9 9J&,q0 9 9 9   a88&z8<<  L ))+|5)QQ*(OOOq(OOOO)$$$)$$$!    @\@@Q@@AAAh1$     ( (X ( ().y)9 ( (X ( ( (    s 9B C 0CC c td|d|dddd} |j||}tdt |d|D]} |sS|j|jr4td|jd|d xxd z cc<Y|j ||d xxd z cc<td |jd |j d|j #t$r?}t d|jd||dxxd z cc<Yd}~d}~wwxYwnD#t$r7}t d||dxxd z cc<Yd}~nd}~wwxYwtd|d d|d d|dd|S)zSync activities for a date range. Args: start_date: Start date end_date: End date force: If True, re-sync existing activities Returns: Statistics dictionary zSyncing activities from r<rr?zFound z activitieszSkipping activity r*rAr>r@u✓ Synced activity r=z) on zError saving activity r,rBNzAPI error fetching activities: zActivity sync complete: rDrErF)r#r$rfetch_activitieslenractivity_exists activity_idr. save_activity activity_typerr3r2r)rr8r9r(rH activitiesactivityr6s rsync_activities_rangez$HealthDataSync.sync_activities_ranges  Az A Ax A A   a88 !55j(KKJ KK=Z=== > > >&   !T\%A%A(BV%W%W! X1EXXXi(((A-((( L..x888(OOOq(OOOKKIx/CII$2II9AII !LL!U(:N!U!URS!U!UVVV(OOOq(OOOHHHH% . ! ! ! LL>1>> ? ? ? (OOOq OOOOOOOO !   (X ( ().y)9 ( (X ( ( (    sPA E34AD&E3 AD&%E3& E/05E*%E3*E//E33 F4=-F//F4 metric_typesc :|s)dtjD}n d|D}tdt |d|d|i}|D]} |||||}|||<|ddkr#|j|||d Q#t$r3}t d |d |ddd d ||<Yd}~d}~wwxYw | |||} | |d<| ddkr#|jd|| d n=#t$r0}t d|ddd d |d<Yd}~nd}~wwxYwtd| D} td| D} | dkrdn | dkrdnd} |jd||| | | dkr| dnd|S)a_Sync all (or specified) metrics for a date range. Args: start_date: Start date end_date: End date metric_types: Optional list of metric types to sync (defaults to all) force: If True, re-sync existing data Returns: Dictionary mapping metric type to sync statistics cg|] }|dk| SrR.0mts r z3HealthDataSync.sync_all_metrics..s-%%%%%r!cg|] }|dk| SrXrYrZs rr]z3HealthDataSync.sync_all_metrics..s"LLL2|9K9KB9K9K9Kr!r;z metric types from r<rCr@r) total_recordszFailed to sync r,r>r?NrRzFailed to sync activities: c3BK|]}|ddVdS)r@rNgetr[rs r z2HealthDataSync.sync_all_metrics..0HH!1551--HHHHHHr!c3BK|]}|ddVdS)rBrNrarcs rrez2HealthDataSync.sync_all_metrics..rfr!successpartialfailed all_metricsrF) data_typer8r9statusrecords_synced error_message)r DATA_TYPE_CONFIGkeysr#r$rMrJrupdate_last_sync_stater3r2rTsumvaluescreate_sync_record) rr8r9rUr(resultsr&rHr6activity_stats total_synced total_errorsrms rsync_all_metricszHealthDataSync.sync_all_metricss& M 16688LLMLLLLL Ws<(( W WZ W WX W W   '  K 55XU6(- $?Q&&I44#XU8_5    A{AAaAABBB23Q'O'O $  M!77 HTY7ZZN$2GL !h'!++ 00 (.:R1 M M M LL:q:: ; ; ;/0Q!$L$LGL ! ! ! ! ! ! M HHw~~7G7GHHHHH HHw~~7G7GHHHHH *a//A E F&FF until_datecv|st}|s+ttj}t d|di}|D]} |j|}|r|tdz}n8ttj }t |d|dddd}tj }|tdz } t|| } || kr|dkr||| d } n|||| d } |d xx| d dz cc<|d xx| d dz cc<|d xx| d dz cc<||krt d|d|d|dkr|||d } n||||d } |d xx| d dz cc<|d xx| d dz cc<|d xx| d dz cc<|d dkrA|d dkr5|d dkr)|| kr#||krt |d|||<|d dkr|j||#t&$r4} t d|d| dddd||<Yd} ~ d} ~ wwxYw|S)a#Perform incremental sync for all metrics since last sync. Args: metric_types: Optional list of metric types to sync until_date: Optional end date (defaults to yesterday) Returns: Dictionary mapping metric type to sync statistics z!Starting incremental sync (until )r>)rGz" not synced before, starting from rr?rRFrCr@rArBzForce syncing z for today (Tz already up to datezIncremental sync failed for r,N)rlistr rprqr#r$rget_last_sync_daterrHISTORICAL_START_DATErtodayminrTrJrbrrr3r2)rrUr{rvr& last_syncr8rHr yesterdayhistorical_endh_statst_statsr6s rsync_incrementalzHealthDataSync.sync_incremental$s )&J @ 7 < < > >??L E EEEFFF'@ @ K?  I88EE !*YA->->->!>JJ",F,H!I!IJKK&VV*VV$%a@@ !I1$5$5$55 "%Z!;!;//"l22"&"<"\} } t d| d | dd| dd| dd ?|S)aIBackfill historical data in batches. Args: start_date: Start date for backfill end_date: End date (defaults to yesterday) metric_types: Optional list of metric types batch_size: Days per batch (default: 30) Returns: Aggregated sync statistics z"Starting historical backfill from r<r=r>z days, batch size: r}z Processing z batchesci|] }|dddd S)rr?rYrZs r z6HealthDataSync.backfill_historical..s19 9 9 =?B1a889 9 9 r!u 📦 Batch /r,)rUrr?r@rArBu" ✅ Historical backfill complete!u 📊 Final Statistics:z rDrErF)rr~r rprqr#r$rGrrM enumeraterzitemsrb) rr8r9rUrbatchesaggregated_resultsi batch_start batch_end batch_resultsr&rHs rbackfill_historicalz"HealthDataSync.backfill_historicals$ '$H @ 7 < < > >??L  S S S S SJ&,q0 S SEO S S S   #:xDD 8#g,,8889999 9 CO9 9 9 ,5Wa+@+@ T T 'A' Y KKPPPCLLPPKPPYPP   !11Y\2M '4&9&9&;&; T T" U&888ABq\]6^6^&{3";/999UYYxQR=S=SS999";/ :::eii ST>U>UU:::";/999UYYxQR=S=SS9999  T  9::: .///"4":":"<"<   K KKH[HHE(OHH#HH/4XHHH     "!r!ci}|j}tjD]5}||vr%||}|d|d|ddd||<+ddddd||<6|S) zzGet current sync status for all data types. Returns: Dictionary with sync status information last_sync_dater_ updated_atr@)rr_rrmNr never_synced)rget_all_last_sync_statesr rprq)rrm all_statesrlstates rget_sync_statuszHealthDataSync.get_sync_statuss Y7799 05577  IJ&&"9-&+,<&=%*?%;"' "5& %%y!!'+%&"&, %%y!! r!)NNN)rN)F)NF)NN)__name__ __module__ __qualname____doc__rr r rr r%strrboolr7rintrJrTrrzrr DEFAULT_BATCH_SIZE_DAYSrrrrYr!rrrs@@04+/+/ //+,/-(/'( /  ////"1111BG***-1*:>* ****b ,,,, ,  , c3h ,,,,^?D:::*.:7;: c3h::::@-1 RRRRtCy) R  R c4S>! " RRRRl-1%)ZZtCy)ZTNZ c4S>! " ZZZZ~$(,0 8 @"@"@"4.@"tCy) @"  @" c4S>! " @"@"@"@"Dc3hr!rN)"rdatetimerrtypingrrrrr pathlibr healthr health.services.garmin_clientr health.services.storager health.db.repositoryrhealth.utils.exceptionsrrhealth.utils.date_utilsrrrrrhealth.utils.logging_configrrr#rrYr!rrsj %$$$$$$$33333333333333<<<<<<111111111111========544444 h  @@@@@@@@@@r!