Commit graph

79 commits

Author SHA1 Message Date
9699bed480
short circuit getCandles if a negative cache exists 2026-06-30 16:44:15 -07:00
bb04d7babd
Tiingo as live provider message parsing - working end to end 2026-06-30 07:38:32 -07:00
0f09c6d31a
implement Tiingo IEX 2026-06-29 21:17:35 -07:00
a73966ad39
support Tiingo power tier rate limit 2026-06-29 20:53:42 -07:00
1bca0d596d
add price live streaming support (quote only/Yahoo only) 2026-06-29 15:57:33 -07:00
a978b2352e
add server api key support 2026-06-29 15:34:48 -07:00
0cd01dd452
fix bug in market-aware cache ttl. The function+tests is a bit overkill, but this is hard...
All checks were successful
Generic zig build / build (push) Successful in 4m52s
Generic zig build / publish-macos (push) Successful in 12s
Generic zig build / deploy (push) Successful in 18s
2026-06-26 16:28:53 -07:00
375af77b58
tweak to earnings refresh based on data seen in the wild 2026-06-26 15:57:29 -07:00
72e874f052
add jitter to earnings
All checks were successful
Generic zig build / build (push) Successful in 4m39s
Generic zig build / publish-macos (push) Successful in 12s
Generic zig build / deploy (push) Successful in 19s
2026-06-25 16:12:31 -07:00
c3c990fa68
market-aware ttl 2026-06-25 14:46:08 -07:00
d619091831
full emdash (and other) scrub 2026-06-25 10:13:25 -07:00
a875fc3b32
fix memory leak in earnings tab 2026-06-24 10:52:38 -07:00
609f3aacd2
resolve TODO surrounding cache ttl on supplementary providers 2026-06-24 10:45:55 -07:00
9139c36e09
wire tiingo to rate limiter 2026-06-19 15:10:49 -07:00
6ecd16334e
introduce real yahoo-based live quote fetching (limited test - market closed during testing) 2026-06-19 15:01:18 -07:00
e246d1e9fe
rely on cache clear to delete data - force refresh now simply tops off the candle data 2026-06-19 09:56:56 -07:00
1c4f85f8da
add exposure command
All checks were successful
Generic zig build / build (push) Successful in 5m58s
Generic zig build / publish-macos (push) Successful in 13s
Generic zig build / deploy (push) Successful in 27s
2026-06-17 12:50:42 -07:00
78ffecba4f
remove remaining AlphaVantage code 2026-06-16 19:44:30 -07:00
867f9afb8c
add cusip to etf profile 2026-06-16 16:57:27 -07:00
415071b955
dedup cusip cache and actually use the cache 2026-06-16 16:00:53 -07:00
b3645a7bd1
convert service to async pattern 2026-06-11 16:22:26 -07:00
b6050bb653
explicit allocator parameters in cache store/service tier, store arena in TUI PortfolioData 2026-06-10 15:43:57 -07:00
b796a46699
move Wikidata -> edgar logic into getClassification
All checks were successful
Generic zig build / build (push) Successful in 4m20s
Generic zig build / deploy (push) Successful in 17s
Generic zig build / publish-macos (push) Successful in 41s
2026-06-01 16:11:09 -07:00
4d65cc45f4
estimateWaitSeconds needs to take a data type due to provider diffs
All checks were successful
Generic zig build / build (push) Successful in 9m51s
Generic zig build / publish-macos (push) Successful in 10s
Generic zig build / deploy (push) Successful in 25s
2026-06-01 12:32:27 -07:00
f54faf4732
add jitter to splits and dividends 2026-06-01 11:57:48 -07:00
7fb674f467 enrich enrich command, remove AlphaVantage
This (huge) commit pulls out AlphaVantage in favor of utilizing
Wikidata and SEC EDGAR data sources (both free). It uses some
built-in heuristics to fill in gaps, and it is not 100% (never
will be), but should get close enough to allow hand-editing of
metadata.srf afterwords without too much labor
2026-05-30 10:40:34 -07:00
52afd75696 update srf/wire edgar and wikidata into service 2026-05-29 12:23:43 -07:00
cc2087fd07 add Edgar/Wikidata providers that will replace AlphaVantage 2026-05-27 10:14:06 -07:00
dfd64bf511 introduce jitter capabilities to ttl in prep for new data types in store 2026-05-26 10:53:38 -07:00
56e462fae9 surface data gaps in alphavantage through enrich 2026-05-24 10:28:54 -07:00
c410bf97b1 create a set of fetch options and wire it into CLI for flags to work properly 2026-05-21 12:17:48 -07:00
e1b99d63b6 remove frequency and add ability to "upgrade" fields 2026-05-20 16:00:13 -07:00
ebf10fcf94 allow tiingo to merge in dividends/splits not captured by primary provider 2026-05-20 15:20:44 -07:00
1311948fa1 rectify price return calculations with Tiingo data 2026-05-20 11:47:57 -07:00
87dfb71fd6 better reporting on http related issues 2026-05-20 11:06:48 -07:00
f2f0b53009 data refresh policy 2026-05-18 17:58:27 -07:00
ea978dfe85 be more clear what negative cache means 2026-05-18 16:18:26 -07:00
80a00009d8 land date refactor (similar to money) 2026-05-12 21:40:32 -07:00
53b807d12e upgrade to zig 0.16.0
IO-as-an-interface refactor across the codebase. The big shifts:
- std.io → std.Io, std.fs → std.Io.Dir/File, std.process.Child → spawn/run.
- Juicy Main: pub fn main(init: std.process.Init) gives gpa, io, arena,
  environ_map up front. main.zig + the build/ scripts use it directly.
- Threading io through everywhere that touches the outside world (HTTP,
  files, stderr, sleep, terminal detection). Functions taking `io` now
  announce side effects at the call site — the smell is the feature.
- date math takes `as_of: Date`, not `today: Date`. Caller resolves
  `--as-of` flag vs wall-clock at the boundary; the function operates
  on whatever date it's given. Every "today" parameter renamed and
  the as_of: ?Date + today: Date pattern collapsed.
- now_s: i64 (or before_s/after_s pairs) for sub-second metadata
  fields like snapshot captured_at, audit cadence, formatAge/fmtTimeAgo.
  Also pure and testable.
- legitimate Timestamp.now callers (cache TTL math, FetchResult
  timestamps, rate limiter, per-frame TUI "now" captures) gain
  `// wall-clock required: ...` comments justifying the read.

Test discovery: replaced the local refAllDeclsRecursive with bare
std.testing.refAllDecls(@This()). Sema-pulling main.zig's top-level
decls reaches every test file transitively through the import graph;
no explicit _ = @import(...) lines needed.

Cleanup along the way:
- Dropped DataService.allocator()/io() accessor methods; renamed the
  fields to drop the base_ prefix. Callers use self.allocator and
  self.io directly.
- Dropped now-vestigial io parameters from buildSnapshot,
  analyzePortfolio, compareSchwabSummary, compareAccounts,
  buildPortfolioData, divs.display, quote.display, parsePortfolioOpts,
  aggregateLiveStocks, renderEarningsLines, capitalGainsIndicator,
  aggregateDripLots, printLotRow, portfolio.display, printSnapNote.
- Dropped the unused contributions.computeAttribution date-form
  wrapper (only computeAttributionSpec is called).
- formatAge/fmtTimeAgo take (before_s, after_s) instead of io and
  reading the clock internally.
- parseProjectionsConfig uses an internal stack-buffer
  FixedBufferAllocator instead of an allocator parameter.
- ThreadSafeAllocator wrappers in cache concurrency tests dropped
  (0.16's DebugAllocator is thread-safe by default).
- analyzePortfolio bug surfaced by the rename: snapshot.zig was
  passing wall-clock today instead of as_of, mis-valuing cash/CDs
  for historical backfills.

83 new unit tests added due to removal of IO, bringing coverage from 58%
-> 64%
2026-05-09 22:40:33 -07:00
57d3b03623 unnoisy the tests 2026-05-08 12:30:48 -07:00
832ce93155 check etag header if present, give a single retry on body validation error 2026-05-08 12:21:31 -07:00
d9c00b6bcb more robuster error capturing - looks like torn srf is in http transit 2026-05-08 11:50:50 -07:00
c21ff84758 begin transfer log 2026-05-06 22:10:13 -07:00
2ac1d30c37 address symptom of Torn SRF files while we track this down 2026-05-02 10:07:59 -07:00
f7c6224a1b periodic review: projections --as-of, contributions --since, comparison and tui projections date picker 2026-05-01 15:59:17 -07:00
441735b3c6 use atomic file writes for data pulling from server 2026-05-01 08:53:14 -07:00
494177ca24 replace finnhub with fmp - finnhub data not correct 2026-04-30 15:22:52 -07:00
742c237515 move to thread safe allocator to address issues on parallel fetch 2026-04-24 06:20:23 -07:00
75570419c5 enable early skip check when cache is fresh 2026-04-22 01:15:00 -07:00
92b4c608ea refactor config/add default files 2026-04-21 12:08:16 -07:00