History

Askill 966e54e5c6 snapshot from private github repo		2024-07-18 11:30:33 +02:00
..
.github/workflows	snapshot from private github repo	2024-07-18 11:30:33 +02:00
cache	snapshot from private github repo	2024-07-18 11:30:33 +02:00
src	snapshot from private github repo	2024-07-18 11:30:33 +02:00
tests	snapshot from private github repo	2024-07-18 11:30:33 +02:00
.gitignore	snapshot from private github repo	2024-07-18 11:30:33 +02:00
Dockerfile	snapshot from private github repo	2024-07-18 11:30:33 +02:00
__init__.py	snapshot from private github repo	2024-07-18 11:30:33 +02:00
deployment.yaml	snapshot from private github repo	2024-07-18 11:30:33 +02:00
dev.py	snapshot from private github repo	2024-07-18 11:30:33 +02:00
keywords.txt	snapshot from private github repo	2024-07-18 11:30:33 +02:00
license.txt	snapshot from private github repo	2024-07-18 11:30:33 +02:00
main.py	snapshot from private github repo	2024-07-18 11:30:33 +02:00
prod.py	snapshot from private github repo	2024-07-18 11:30:33 +02:00
readme.md	snapshot from private github repo	2024-07-18 11:30:33 +02:00
requirements.txt	snapshot from private github repo	2024-07-18 11:30:33 +02:00
sites.txt	snapshot from private github repo	2024-07-18 11:30:33 +02:00

readme.md

Optar

This tool crawles all pages on a given website to the provided deapth and finds new pages by comparing the new site tree to the cached one. All new pages are then checked for containing any of the provided keywords. If there is a match the page will be higlighted for the reader. Default timeout 1h, list of keywords and sites can be changed while the software is running.

Only retrieves static content, client side rendered content crawling is not implemented.