Commit graph

66 commits

Author SHA1 Message Date
9139c36e09
wire tiingo to rate limiter 2026-06-19 15:10:49 -07:00
6ecd16334e
introduce real yahoo-based live quote fetching (limited test - market closed during testing) 2026-06-19 15:01:18 -07:00
e246d1e9fe
rely on cache clear to delete data - force refresh now simply tops off the candle data 2026-06-19 09:56:56 -07:00
1c4f85f8da
add exposure command
All checks were successful
Generic zig build / build (push) Successful in 5m58s
Generic zig build / publish-macos (push) Successful in 13s
Generic zig build / deploy (push) Successful in 27s
2026-06-17 12:50:42 -07:00
78ffecba4f
remove remaining AlphaVantage code 2026-06-16 19:44:30 -07:00
867f9afb8c
add cusip to etf profile 2026-06-16 16:57:27 -07:00
415071b955
dedup cusip cache and actually use the cache 2026-06-16 16:00:53 -07:00
b3645a7bd1
convert service to async pattern 2026-06-11 16:22:26 -07:00
b6050bb653
explicit allocator parameters in cache store/service tier, store arena in TUI PortfolioData 2026-06-10 15:43:57 -07:00
b796a46699
move Wikidata -> edgar logic into getClassification
All checks were successful
Generic zig build / build (push) Successful in 4m20s
Generic zig build / deploy (push) Successful in 17s
Generic zig build / publish-macos (push) Successful in 41s
2026-06-01 16:11:09 -07:00
4d65cc45f4
estimateWaitSeconds needs to take a data type due to provider diffs
All checks were successful
Generic zig build / build (push) Successful in 9m51s
Generic zig build / publish-macos (push) Successful in 10s
Generic zig build / deploy (push) Successful in 25s
2026-06-01 12:32:27 -07:00
f54faf4732
add jitter to splits and dividends 2026-06-01 11:57:48 -07:00
7fb674f467 enrich enrich command, remove AlphaVantage
This (huge) commit pulls out AlphaVantage in favor of utilizing
Wikidata and SEC EDGAR data sources (both free). It uses some
built-in heuristics to fill in gaps, and it is not 100% (never
will be), but should get close enough to allow hand-editing of
metadata.srf afterwords without too much labor
2026-05-30 10:40:34 -07:00
52afd75696 update srf/wire edgar and wikidata into service 2026-05-29 12:23:43 -07:00
cc2087fd07 add Edgar/Wikidata providers that will replace AlphaVantage 2026-05-27 10:14:06 -07:00
dfd64bf511 introduce jitter capabilities to ttl in prep for new data types in store 2026-05-26 10:53:38 -07:00
56e462fae9 surface data gaps in alphavantage through enrich 2026-05-24 10:28:54 -07:00
c410bf97b1 create a set of fetch options and wire it into CLI for flags to work properly 2026-05-21 12:17:48 -07:00
e1b99d63b6 remove frequency and add ability to "upgrade" fields 2026-05-20 16:00:13 -07:00
ebf10fcf94 allow tiingo to merge in dividends/splits not captured by primary provider 2026-05-20 15:20:44 -07:00
1311948fa1 rectify price return calculations with Tiingo data 2026-05-20 11:47:57 -07:00
87dfb71fd6 better reporting on http related issues 2026-05-20 11:06:48 -07:00
f2f0b53009 data refresh policy 2026-05-18 17:58:27 -07:00
ea978dfe85 be more clear what negative cache means 2026-05-18 16:18:26 -07:00
80a00009d8 land date refactor (similar to money) 2026-05-12 21:40:32 -07:00
53b807d12e upgrade to zig 0.16.0
IO-as-an-interface refactor across the codebase. The big shifts:
- std.io → std.Io, std.fs → std.Io.Dir/File, std.process.Child → spawn/run.
- Juicy Main: pub fn main(init: std.process.Init) gives gpa, io, arena,
  environ_map up front. main.zig + the build/ scripts use it directly.
- Threading io through everywhere that touches the outside world (HTTP,
  files, stderr, sleep, terminal detection). Functions taking `io` now
  announce side effects at the call site — the smell is the feature.
- date math takes `as_of: Date`, not `today: Date`. Caller resolves
  `--as-of` flag vs wall-clock at the boundary; the function operates
  on whatever date it's given. Every "today" parameter renamed and
  the as_of: ?Date + today: Date pattern collapsed.
- now_s: i64 (or before_s/after_s pairs) for sub-second metadata
  fields like snapshot captured_at, audit cadence, formatAge/fmtTimeAgo.
  Also pure and testable.
- legitimate Timestamp.now callers (cache TTL math, FetchResult
  timestamps, rate limiter, per-frame TUI "now" captures) gain
  `// wall-clock required: ...` comments justifying the read.

Test discovery: replaced the local refAllDeclsRecursive with bare
std.testing.refAllDecls(@This()). Sema-pulling main.zig's top-level
decls reaches every test file transitively through the import graph;
no explicit _ = @import(...) lines needed.

Cleanup along the way:
- Dropped DataService.allocator()/io() accessor methods; renamed the
  fields to drop the base_ prefix. Callers use self.allocator and
  self.io directly.
- Dropped now-vestigial io parameters from buildSnapshot,
  analyzePortfolio, compareSchwabSummary, compareAccounts,
  buildPortfolioData, divs.display, quote.display, parsePortfolioOpts,
  aggregateLiveStocks, renderEarningsLines, capitalGainsIndicator,
  aggregateDripLots, printLotRow, portfolio.display, printSnapNote.
- Dropped the unused contributions.computeAttribution date-form
  wrapper (only computeAttributionSpec is called).
- formatAge/fmtTimeAgo take (before_s, after_s) instead of io and
  reading the clock internally.
- parseProjectionsConfig uses an internal stack-buffer
  FixedBufferAllocator instead of an allocator parameter.
- ThreadSafeAllocator wrappers in cache concurrency tests dropped
  (0.16's DebugAllocator is thread-safe by default).
- analyzePortfolio bug surfaced by the rename: snapshot.zig was
  passing wall-clock today instead of as_of, mis-valuing cash/CDs
  for historical backfills.

83 new unit tests added due to removal of IO, bringing coverage from 58%
-> 64%
2026-05-09 22:40:33 -07:00
57d3b03623 unnoisy the tests 2026-05-08 12:30:48 -07:00
832ce93155 check etag header if present, give a single retry on body validation error 2026-05-08 12:21:31 -07:00
d9c00b6bcb more robuster error capturing - looks like torn srf is in http transit 2026-05-08 11:50:50 -07:00
c21ff84758 begin transfer log 2026-05-06 22:10:13 -07:00
2ac1d30c37 address symptom of Torn SRF files while we track this down 2026-05-02 10:07:59 -07:00
f7c6224a1b periodic review: projections --as-of, contributions --since, comparison and tui projections date picker 2026-05-01 15:59:17 -07:00
441735b3c6 use atomic file writes for data pulling from server 2026-05-01 08:53:14 -07:00
494177ca24 replace finnhub with fmp - finnhub data not correct 2026-04-30 15:22:52 -07:00
742c237515 move to thread safe allocator to address issues on parallel fetch 2026-04-24 06:20:23 -07:00
75570419c5 enable early skip check when cache is fresh 2026-04-22 01:15:00 -07:00
92b4c608ea refactor config/add default files 2026-04-21 12:08:16 -07:00
59760a1da8 centralize accounts.srf loading 2026-04-11 09:51:25 -07:00
5b8c163291 merge adj_close and div reinvestment strategies to compensate for data inconsistency 2026-03-29 10:53:24 -07:00
7c6c0ce59b more measured fallback and logging 2026-03-24 18:57:22 -07:00
167c960685 disable twelvedata candles due to inconsistent dividend handling 2026-03-24 18:17:19 -07:00
239fd61ac8 use adj_close returns in most cases (accounting for splits and dividends 2026-03-24 05:14:30 -07:00
8576293898 logging and tests 2026-03-20 10:39:38 -07:00
678c70467a rework the data load 2026-03-20 09:48:03 -07:00
94188ae4a9 add tiingo provider as primary for candles 2026-03-17 08:52:25 -07:00
b0c5dc3e21 add Yahoo finance into the mix for candles and quotes 2026-03-11 15:31:17 -07:00
1d3ccbdb50 add debug statements so we can see what is going on if needed 2026-03-11 13:36:04 -07:00
cd5de92006 implement a server cache sync 2026-03-11 13:01:37 -07:00
2f84bbd3e8 exclude mutual funds from any server fetch - they do not have earnings 2026-03-11 11:45:34 -07:00
f1eafaafd7 finish service.zig cleanup 2026-03-10 13:40:06 -07:00