Commit Graph

40 Commits

Author SHA1 Message Date
Jonas Linter
c5fa92c4ec Fixed stuff 2025-11-10 13:07:08 +01:00
Jonas Linter
a92c5b699f But no account_currency 2025-11-10 11:49:00 +01:00
Jonas Linter
5f83ecd7ee Fix field schema validation test and update database schema
- Fixed field extraction logic in test_field_schema_validation.py to properly parse methods with docstrings
  - Previous regex was too greedy and matched across multiple method definitions
  - Now uses proper parenthesis and docstring matching to isolate method bodies
  - Correctly handles both 'fields = [...]' and 'fields = common_fields + [...]' patterns

- Updated db_schema.sql to include missing columns:
  - campaign_insights: added frequency, cpp, cost_per_action_type columns
  - adset_insights: added account_currency column
  - campaign_insights_by_country: added frequency, cpp, cost_per_action_type columns

- All field schema validation tests now pass
  - Test dynamically extracts fields from scheduled_grabber.py source code
  - Compares against actual database schema from db_schema.sql
  - Properly filters metadata-only fields (campaign_id, campaign_name, etc.)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-10 11:48:17 +01:00
Jonas Linter
511f381ff2 Simplified insight grabbers 2025-11-10 11:27:54 +01:00
Jonas Linter
03ae7ea61a No need to include the field. Its auto included from the breakdown 2025-11-10 11:06:59 +01:00
Jonas Linter
987553ef74 Again. 2025-11-10 10:50:44 +01:00
Jonas Linter
8f4753ff20 Should work now 2025-11-10 10:43:04 +01:00
Jonas Linter
3ae4ce0d83 Added country level statistics on the campaign level 2025-11-10 10:26:49 +01:00
e577945e75 Probably fixed initial view setup. Needs create drop then recreate 2025-11-05 21:05:36 +00:00
68223f664a Managing views in meta_api_grabber now 2025-11-05 15:43:01 +00:00
750ff0d4ff Archive view creation code 2025-11-05 15:26:08 +00:00
Jonas Linter
630f541b4f Another test 2025-11-04 12:02:05 +01:00
9ff1ee31d0 Merge branch 'main' of https://gitea.99tales.net/jonas/meta_api_grabber 2025-11-04 10:53:27 +00:00
Jonas Linter
f962a1a83d Individual stats for account rate limits 2025-11-04 11:53:11 +01:00
df6da80320 Merge branch 'main' of https://gitea.99tales.net/jonas/meta_api_grabber 2025-11-04 10:43:13 +00:00
Jonas Linter
6127ea4650 Updated meta rate limiter logs 2025-11-04 11:42:18 +01:00
d38bb5d4a8 Added docker build command to readme 2025-10-28 15:43:24 +00:00
Jonas Linter
638b466daf Fixed erroneous upsert 2025-10-28 15:41:36 +01:00
Jonas Linter
d9260dff35 More logging 2025-10-28 15:32:09 +01:00
Jonas Linter
845a130aad Added some logging 2025-10-28 15:25:42 +01:00
Jonas Linter
805c90f76e Merge branch 'main' of git.99tales.net:jonas/meta_api_grabber 2025-10-28 11:11:02 +01:00
Jonas Linter
61e09fe467 Why am I missing campaign names ?? 2025-10-28 11:10:40 +01:00
Jonas Linter
3e9e568ed6 Upped interval to 1h 2025-10-23 16:29:02 +02:00
Jonas Linter
b8f1128108 Backfill 2025-10-22 17:56:59 +02:00
Jonas Linter
cb26ac9132 Fixed date preset not being correctly updated in table 2025-10-22 11:58:50 +02:00
Jonas Linter
0aba33ca8d Campaign missing from db when running campaign_insights 2025-10-22 08:22:25 +02:00
Jonas Linter
aee467c672 Fixed oversight 2025-10-21 18:43:25 +02:00
Jonas Linter
17020be715 Removed restrictions 2025-10-21 18:41:03 +02:00
4e150818c5 Merge branch 'main' of https://gitea.99tales.net/jonas/meta_api_grabber 2025-10-21 16:21:33 +00:00
Jonas Linter
74c9ee6ec5 Copy readme aswell 2025-10-21 18:21:10 +02:00
9783ff65e7 Wrong python version in dockerfile 2025-10-21 16:21:03 +00:00
Jonas Linter
794599a454 Updated computed_timstamp. Changed approach 2025-10-21 18:16:31 +02:00
Jonas Linter
ec10ca51e0 Mostly ready for first test run but there is one improvement I want to implement first 2025-10-21 17:46:27 +02:00
Jonas Linter
6e4cc7ed1d Added date_fields 2025-10-21 17:16:30 +02:00
Jonas Linter
3fe923f5a7 works but need to do more research on how the token should be exactly handled 2025-10-21 14:00:14 +02:00
Jonas Linter
b6585b280f Db initialization works 2025-10-21 13:43:12 +02:00
Jonas Linter
453af3a408 Updated claude instructions 2025-10-21 13:32:01 +02:00
Jonas Linter
3704390448 Ratelimiting and timescaledb changes 2025-10-21 13:28:29 +02:00
Jonas Linter
6ba8a0dba2 Updated data collection system 2025-10-21 11:55:14 +02:00
Jonas Linter
0d754846ce Insight grabber funktioniert. 2025-10-21 10:54:21 +02:00