Commit graph

78 commits

Author SHA1 Message Date
Vincent Cloutier
55b8244d13 magic numbers update 2023-01-05 15:02:24 -05:00
Vincent Cloutier
5c75e79abc boundedcapacity change 2023-01-03 14:50:05 -05:00
Vincent Cloutier
43fb42727e bigger user batch 2023-01-01 15:55:05 -05:00
Vincent Cloutier
3e5b01a923 remove dead code 2023-01-01 15:18:54 -05:00
Vincent Cloutier
97d40b21fb switched to vanilla npgsql for more queries 4 2023-01-01 11:58:36 -05:00
Vincent Cloutier
8551763f77 small changes all over the place 2023-01-01 11:27:00 -05:00
Vincent Cloutier
f2c0d55916 version updates 2023-01-01 11:09:40 -05:00
Vincent Cloutier
b1b8b676b9 changed some magic 2022-12-29 13:02:38 -05:00
Vincent Cloutier
f8c3b5cac7 added twitter user tests 2022-12-28 14:49:49 -05:00
Vincent Cloutier
5fafb1f568 delay tweaking 2022-12-28 13:32:08 -05:00
Vincent Cloutier
ea47f2c058 removed pipeline stage 2022-12-28 11:35:06 -05:00
Vincent Cloutier
d46efe8812 fix 2022-12-28 11:17:54 -05:00
Vincent Cloutier
d6cf46f0c6 removed unneccesary delay 2 2022-12-28 11:05:03 -05:00
Vincent Cloutier
8bc044eeba removed unneccesary delay 2022-12-28 11:00:24 -05:00
Vincent Cloutier
6b6a943294 made RetrieveFollowersProcessor more parallel 2022-12-28 10:59:15 -05:00
Vincent Cloutier
a9b3bc8da9 made inbox processing more async 2022-12-28 10:30:58 -05:00
Vincent Cloutier
e7197f3054 made twitteruser more async 2022-12-28 10:23:46 -05:00
Vincent Cloutier
dbabd61418 increase pipeline depth 2022-12-27 12:37:06 -05:00
Vincent Cloutier
7f772ca125 Various optimisations 2022-12-27 12:15:10 -05:00
Vincent Cloutier
dfdcb77924 some rollbacks 2022-12-26 15:19:46 -05:00
Vincent Cloutier
5e0cb44c8e more logging 2022-12-26 15:05:46 -05:00
Vincent Cloutier
999e0c2ba2 fixed tests 2022-12-26 14:14:25 -05:00
Vincent Cloutier
94f8d40256 more tweaks 2022-12-26 11:48:13 -05:00
Vincent Cloutier
e21381bee8 made twitter service more async 2022-12-26 11:13:00 -05:00
Vincent Cloutier
29d8091997 further pipeline changes 2022-12-26 10:47:26 -05:00
Vincent Cloutier
e7438057d1 reduced batch size 2022-12-25 14:41:28 -05:00
Vincent Cloutier
2290c2a121 some rate limiting 2022-12-18 16:12:16 -05:00
Vincent Cloutier
d0e4a09d3d boosts v1 2022-05-09 20:31:18 -04:00
Vincent Cloutier
7502ceba9f more logging 2 2022-05-08 13:51:35 -04:00
Vincent Cloutier
c670789315 even more logging 2022-05-08 13:45:11 -04:00
Vincent Cloutier
7be7246527 even more logging 2022-05-07 18:43:46 -04:00
Vincent Cloutier
fca3193074 more logging 2022-05-07 18:35:35 -04:00
Vincent Cloutier
6b2579db50 wip 1 2022-05-05 20:15:07 -04:00
Nicolas Constant
d1c5a59247
fix tests 2022-02-07 19:33:08 -05:00
Nicolas Constant
662f97e53c
added proper exception in user retrieval 2022-02-07 18:48:10 -05:00
Nicolas Constant
3a998b60ac
added auto clean-up on failing follower 2022-02-02 21:33:45 -05:00
Nicolas Constant
5ef8af47eb
set LastSync in failing user retrieval 2021-11-20 17:04:48 -05:00
Nicolas Constant
143d431f0f
set twitter users' errors limit threshold in config 2021-11-15 23:29:39 -05:00
Nicolas Constant
18d2096dc3
fix follower interator 2021-09-10 23:28:36 -04:00
Nicolas Constant
77e3caebe0
added saving posting errors 2021-09-10 20:47:02 -04:00
Nicolas Constant
5121f6c7c2
disabling extra awaiter on user retrieval 2021-09-10 01:21:40 -04:00
Nicolas Constant
363481a997
Merge pull request #117 from NicolasConstant/topic_remove-deleted-twitter-users
Topic remove deleted twitter users
2021-09-10 01:15:54 -04:00
Nicolas Constant
c4ee6be8ce
added reset error count 2021-09-05 14:38:56 -04:00
Nicolas Constant
f7e00b4562
testing refresh user pipeline 2021-09-05 14:35:28 -04:00
Nicolas Constant
b28532b5bd
removal of old user analysis 2021-09-05 14:00:18 -04:00
Nicolas Constant
71f6d3f3f4
added pipeline processor to analyse user state 2021-09-05 13:58:33 -04:00
Nicolas Constant
66e1e84da2
added waiting time to fit 100.000 rate limit 2021-09-05 01:03:01 -04:00
Nicolas Constant
cad6c2018e
fix warm up number 2021-04-15 19:39:33 -04:00
Nicolas Constant
f0dc54ad01
added log and resiliency 2021-02-15 18:54:52 -05:00
Nicolas Constant
5f480b4baa
don't retrieve TL if user is protected 2021-02-10 01:35:29 -05:00