Commit Graph

40 Commits

Author SHA1 Message Date
bernard-ng dad5e343d1 [db] change field case 2025-11-04 16:21:21 +02:00
bernard-ng 6eb2ed08e5 [crawler] configuration based api 2025-11-04 16:19:01 +02:00
BernardNganduDev 7be4f84c32 [backend]: remove mmdb files 2025-11-03 10:03:41 +02:00
Bernard Ngandu 0b0ed58ef8 Merge pull request #7 from bernard-ng/codex/implement-missing-features-in-crawler
feat(crawler): add http client and persistence utilities
2025-11-02 21:56:21 +02:00
Bernard Ngandu e8b20f6612 feat(crawler): implement http client and persistence 2025-11-02 21:55:53 +02:00
bernard-ng c53c0b576b [crawler]: stabilize import 2025-11-02 21:26:07 +02:00
bernard-ng 07bb3992ad [crawler]: fix conflit 2025-11-02 12:45:45 +02:00
Bernard Ngandu 3ea5f6b35c Merge pull request #6 from bernard-ng/codex/stabilize-apps/crawler-structure
feat(crawler): add configuration manager and cli scripts
2025-11-02 12:14:01 +02:00
Bernard Ngandu c55be3989c feat(crawler): add configuration manager and cli scripts 2025-11-02 12:13:41 +02:00
Bernard Ngandu eafb8a2de9 Merge pull request #5 from bernard-ng/codex/implement-crawler-logic-with-logging
feat: improve crawler async task logging and test support
2025-10-31 23:31:10 +02:00
Bernard Ngandu 69303cb075 feat(crawler): improve async tasks integration 2025-10-31 23:30:24 +02:00
Bernard Ngandu 113941077f Merge pull request #4 from bernard-ng/codex/migrate-database-schema-to-typescript
Port feed management schema and queries to Drizzle
2025-10-31 23:07:40 +02:00
Bernard Ngandu b957b405da Port feed management schema and queries to Drizzle 2025-10-31 23:07:06 +02:00
bernard-ng 67f5673db1 wip: database 2025-10-31 18:23:39 +02:00
bernard-ng 1f4c6b38a1 porting to typescript 2025-10-28 06:45:21 +02:00
Turbobot 57b041bf08 feat(create-turbo): apply package-manager transform 2025-10-28 06:45:21 +02:00
Turbobot e2bcb26d9e feat(create-turbo): apply official-starter transform 2025-10-28 06:45:21 +02:00
Bernard Ngandu fe38d98186 Merge pull request #3 from bernard-ng/codex/port-python-crawler-to-typescript
refactor: centralize crawler schemas and json config
2025-10-28 06:44:45 +02:00
Bernard Ngandu eae1ede15f refactor: centralize crawler schemas and json config 2025-10-28 06:42:45 +02:00
bernard-ng 799cda6e06 [backend, crawler] feat: support token statistics 2025-10-25 03:27:15 +02:00
bernard-ng 8e456cff75 [mobile] remove previous mobile build 2025-10-24 23:51:03 +02:00
bernard-ng 38a813bb3c [backend] fix: deploy path 2025-10-21 01:52:03 +02:00
bernard-ng d81c4acd13 [backend] support postgres 2025-10-20 23:02:14 +02:00
bernard-ng 8244e2ce5f [backend] update queries to postgres 2025-10-20 17:41:29 +02:00
Bernard Ngandu 9f6a88e7f8 Merge pull request #2 from bernard-ng/codex/optimize-backend-queries-for-postgres
Use canonical UUID strings for PostgreSQL queries
2025-10-20 17:36:33 +02:00
Bernard Ngandu 8993b5daec Normalize importer UUID handling for PostgreSQL 2025-10-20 15:09:07 +02:00
Bernard Ngandu 5ac2fcb1fb Use canonical UUID strings for PostgreSQL queries 2025-10-20 14:56:03 +02:00
bernard-ng c334452426 [backend] from mariadb to postgres 2025-10-20 13:50:56 +02:00
Bernard Ngandu 49733e03b7 Merge pull request #1 from bernard-ng/codex/migrate-database-from-mariadb-to-postgresql
Revert PostgreSQL switch and document migration plan
2025-10-18 22:50:03 +02:00
Bernard Ngandu c725797234 Document migration plan and add portable helper 2025-10-18 22:47:49 +02:00
bernard-ng 6855590d6b [backend] bump deps and fix styles 2025-10-07 00:23:41 +02:00
bernard-ng 449718cdf2 [backend] accept articles from crawler 2025-10-07 00:15:38 +02:00
bernard-ng 327ba5179d [crawler]: add runing instructions 2025-10-06 20:20:14 +02:00
bernard-ng e105ff233f fix: async queue 2025-10-06 20:00:54 +02:00
bernard-ng 497633fb61 docs: add status badges 2025-10-06 18:05:53 +02:00
bernard-ng 6a49110b30 [crawler]: fix style with ruff 2025-10-06 18:01:17 +02:00
bernard-ng 6b3e0323c5 fix: github actions 2025-10-06 17:56:34 +02:00
BernardNganduDev 6a12760c99 async support via redis and rq 2025-10-06 16:59:38 +02:00
BernardNganduDev 039402110d feat: crawling html and wordpress sources 2025-10-06 15:18:08 +02:00
bernard-ng 68d521677a Initial commit 2025-10-05 14:42:25 +02:00