Commit graph

90 commits

Author SHA1 Message Date
Vincent Cloutier
da8092cfd5 activity generation refactoring 2023-02-10 11:54:33 -05:00
Vincent Cloutier
e9f3631985 various simplifications 2023-02-03 10:24:50 -05:00
Vincent Cloutier
edec988e05 update some magic numbers 2023-01-27 13:55:19 -05:00
Vincent Cloutier
bd46afa350 fix crash 2023-01-20 14:17:32 -05:00
Vincent Cloutier
c702357cc1 magic tweaks for perf 2023-01-20 13:25:52 -05:00
Vincent Cloutier
714e66e284 added parameter for twitter request parallelism 2023-01-20 12:53:30 -05:00
Vincent Cloutier
4a7373ec07 removed max users 2023-01-20 11:13:00 -05:00
Vincent Cloutier
48d521b757 removed unused nbrTweets 2023-01-20 09:28:32 -05:00
Vincent Cloutier
08f5aef7fc tweak twitter queries parallelism 2 2023-01-15 12:53:04 -05:00
Vincent Cloutier
014dee23a3 tweak twitter queries parallelism 2023-01-15 09:24:30 -05:00
Vincent Cloutier
9026273f45 made tweet fetching concurrent instead 2023-01-10 21:00:21 -05:00
Vincent Cloutier
d1018881ec now fetching twitter feed in parallel 2023-01-10 20:30:07 -05:00
Vincent Cloutier
55b8244d13 magic numbers update 2023-01-05 15:02:24 -05:00
Vincent Cloutier
5c75e79abc boundedcapacity change 2023-01-03 14:50:05 -05:00
Vincent Cloutier
43fb42727e bigger user batch 2023-01-01 15:55:05 -05:00
Vincent Cloutier
3e5b01a923 remove dead code 2023-01-01 15:18:54 -05:00
Vincent Cloutier
97d40b21fb switched to vanilla npgsql for more queries 4 2023-01-01 11:58:36 -05:00
Vincent Cloutier
8551763f77 small changes all over the place 2023-01-01 11:27:00 -05:00
Vincent Cloutier
f2c0d55916 version updates 2023-01-01 11:09:40 -05:00
Vincent Cloutier
b1b8b676b9 changed some magic 2022-12-29 13:02:38 -05:00
Vincent Cloutier
f8c3b5cac7 added twitter user tests 2022-12-28 14:49:49 -05:00
Vincent Cloutier
5fafb1f568 delay tweaking 2022-12-28 13:32:08 -05:00
Vincent Cloutier
ea47f2c058 removed pipeline stage 2022-12-28 11:35:06 -05:00
Vincent Cloutier
d46efe8812 fix 2022-12-28 11:17:54 -05:00
Vincent Cloutier
d6cf46f0c6 removed unneccesary delay 2 2022-12-28 11:05:03 -05:00
Vincent Cloutier
8bc044eeba removed unneccesary delay 2022-12-28 11:00:24 -05:00
Vincent Cloutier
6b6a943294 made RetrieveFollowersProcessor more parallel 2022-12-28 10:59:15 -05:00
Vincent Cloutier
a9b3bc8da9 made inbox processing more async 2022-12-28 10:30:58 -05:00
Vincent Cloutier
e7197f3054 made twitteruser more async 2022-12-28 10:23:46 -05:00
Vincent Cloutier
dbabd61418 increase pipeline depth 2022-12-27 12:37:06 -05:00
Vincent Cloutier
7f772ca125 Various optimisations 2022-12-27 12:15:10 -05:00
Vincent Cloutier
dfdcb77924 some rollbacks 2022-12-26 15:19:46 -05:00
Vincent Cloutier
5e0cb44c8e more logging 2022-12-26 15:05:46 -05:00
Vincent Cloutier
999e0c2ba2 fixed tests 2022-12-26 14:14:25 -05:00
Vincent Cloutier
94f8d40256 more tweaks 2022-12-26 11:48:13 -05:00
Vincent Cloutier
e21381bee8 made twitter service more async 2022-12-26 11:13:00 -05:00
Vincent Cloutier
29d8091997 further pipeline changes 2022-12-26 10:47:26 -05:00
Vincent Cloutier
e7438057d1 reduced batch size 2022-12-25 14:41:28 -05:00
Vincent Cloutier
2290c2a121 some rate limiting 2022-12-18 16:12:16 -05:00
Vincent Cloutier
d0e4a09d3d boosts v1 2022-05-09 20:31:18 -04:00
Vincent Cloutier
7502ceba9f more logging 2 2022-05-08 13:51:35 -04:00
Vincent Cloutier
c670789315 even more logging 2022-05-08 13:45:11 -04:00
Vincent Cloutier
7be7246527 even more logging 2022-05-07 18:43:46 -04:00
Vincent Cloutier
fca3193074 more logging 2022-05-07 18:35:35 -04:00
Vincent Cloutier
6b2579db50 wip 1 2022-05-05 20:15:07 -04:00
Nicolas Constant
d1c5a59247
fix tests 2022-02-07 19:33:08 -05:00
Nicolas Constant
662f97e53c
added proper exception in user retrieval 2022-02-07 18:48:10 -05:00
Nicolas Constant
3a998b60ac
added auto clean-up on failing follower 2022-02-02 21:33:45 -05:00
Nicolas Constant
5ef8af47eb
set LastSync in failing user retrieval 2021-11-20 17:04:48 -05:00
Nicolas Constant
143d431f0f
set twitter users' errors limit threshold in config 2021-11-15 23:29:39 -05:00