Marco Borgeaud
3afafafcb9
Do not validate CERT links
2024-08-22 09:59:26 +02:00
Marco Borgeaud
00eee176da
Improve probing frequency to reduce time spent on CI
...
Checks links every two to three days instead of every 24h to 25h40.
This improve the distribution of checks on CI runs.
2024-08-22 09:59:26 +02:00
Marco Borgeaud
71fa9cb6d3
Print statistics about cache hit/miss
2024-08-22 09:59:26 +02:00
Fred Tingaud
e261bd4b21
Fix Sonar warnings
...
Fix a bunch of Sonar warnings that somehow appear as "New warnings"
although they are a few years old.
2023-09-22 14:41:56 +00:00
Martin Strecker
94f637f126
checklinks.py Fix broken Accept header ( #1194 )
2022-08-29 19:17:24 +02:00
Arseniy Zaostrovnykh
ec478edebc
RULEAPI-763 add an exception for medium.com links in probing script
...
The exceptions might be removed once RULEAPI-763 is resolved
2022-06-08 13:54:26 +02:00
Arseniy Zaostrovnykh
6800da7e05
RULEAPI-762: Fix link-probing cache: cache on failure and success
2022-06-08 13:52:21 +02:00
Arseniy Zaostrovnykh
d444d13593
Fix python issues raised by SQ for the old code
2022-01-13 09:25:17 +01:00
Arseniy Zaostrovnykh
4ad44aee5b
RULEAPI-616: Stabilize the link validation CI check by preserving the probing results between runs
2021-06-03 16:04:36 +02:00
Arseniy Zaostrovnykh
43fff81eb1
Ignore blogs.oracle.com links that work locally but timeout in CI
2021-05-06 15:35:56 +02:00
Arseniy Zaostrovnykh
acd760f75c
Fix the indentation (big deal in Python)
2021-05-06 11:22:12 +02:00
Arseniy Zaostrovnykh
b021d34a09
Use "requests" instead of urllib; improve stability of link probing
...
"requests" library supports HTTP2, HTTPS, coockies by default and
connection:keep-alive header, which increase the number of positive responses
from the probed servers.
Nevertheless, due to unreliable nature of the Internet and flaky performance of
web servers some links occasionaly fail, and with this many links to
probe (1.3k+) it becomes very likely that at least one of them fails.
To mitigate these failures, the script retries the failed links once more.
2021-05-06 11:01:40 +02:00
Arseniy Zaostrovnykh
e42172f8fa
Skip deprecated and superseded rules when checking URLs
2021-04-29 17:58:21 +02:00
Arseniy Zaostrovnykh
034ea0f942
Accept cookies when checking links to better emulate a browser
...
And fix some "infinite redirect" issues for websites, such as
developer.android.com that need cookies
2021-04-29 16:34:59 +02:00
Nicolas Harraudeau
a84840c5b4
Accept local links without checking them.
2021-02-25 16:21:19 +01:00
tomverin
e8530167f5
Check links embeded in adocs files ( #32 )
2021-02-12 15:18:24 +01:00
