Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

collect_mail.py from IETF collects empty .mail files #558

Open
sbenthall opened this issue Apr 8, 2022 · 2 comments
Open

collect_mail.py from IETF collects empty .mail files #558

sbenthall opened this issue Apr 8, 2022 · 2 comments
Milestone

Comments

@sbenthall
Copy link
Collaborator

Something is quite wrong with the IETF data collection procees.

$ python bin/collect_mail.py -u https://www.ietf.org/mail-archive/text/dns-security/
['2008-05.mail',
 '2008-06.mail',
 '2008-07.mail',
 '2008-08.mail',
 '2008-09.mail',
 '2008-10.mail',
 '2008-11.mail',
 '2008-12.mail']

So far so good, but then:























archives/dns-security/2008-09.mail (END)

So no data is getting collected.

@sbenthall sbenthall added this to the 0.4 milestone Apr 8, 2022
@sbenthall
Copy link
Collaborator Author

The mail collection script is downloading all the .mail files from this page:

https://www.ietf.org/mail-archive/text/dns-security/

But these .mail files are empty; the data is actually in the .txt files

@sbenthall
Copy link
Collaborator Author

This is likely related to the fact that dns-security is a deprecated working group

https://www.ietf.org/mail-archive/text/dns-security/dns-security.200003.txt

@sbenthall sbenthall modified the milestones: 0.4, 0.5 Apr 22, 2022
@sbenthall sbenthall modified the milestones: 0.5, 0.6 May 16, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant