Use a background broker to running the crawlers some time to update data stored in project.
Ways to update:
- 1nd : Via button that run crawler file
- 2nd: Every day in some hour ( 1h a.m )
1nd: Use exec_file function
2nd: use some django application to run background tasks periodically or the Schedule: a lib python to abstract the linux's cron
Use a background broker to running the crawlers some time to update data stored in project.
Ways to update:
1nd: Use
exec_filefunction2nd: use some django application to run background tasks periodically or the Schedule: a lib python to abstract the linux's cron