Indexed snapshot.debian.org + give crawler a user-agent
This commit is contained in:
parent
f2bf6829c3
commit
d9def9d542
3 changed files with 34 additions and 8 deletions
|
|
@ -9,7 +9,7 @@ REPOS="core extra community"
|
|||
DEBUG=false
|
||||
SYSID=1
|
||||
|
||||
CURL="curl -fSs"
|
||||
CURL="curl -fSs -A manual-page-crawler,info@manned.org"
|
||||
PSQL="psql -U manned -Awtq"
|
||||
TMP=`mktemp -d manned.arch.XXXXXX`
|
||||
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue