Allow downloading non periodic filings / non financial reports

[jsertx]

Description

This add support to download non financial reports which do not have period of report field.

Consideration

• The full list is not added as the list of submission types is huge.
• I thought about hard coding the list of non_periodic_filing_types list to item_lists.py but this way, there is no need to create a pull request to support other filings.

Disclaimer

I am concerned that the repository is focused on financial reports, but it might be of interest to add support for other kind of filings, as many people (like I did), reached this repo looking to crawl any kind of edgar report.

[eloukas]

Thanks @jsertx for your PR.

Yes, while the toolkit started by focusing on financial-heavy reports with specific dates (like 10-Ks), I do see that there are more and more reports that could be interesting. And, of course, they are related to the repo.

Out of curiosity, could you tell us a bit more how you use form-144? Most of the research I've seen is directed towards 10-Ks, 10-Qs, 8-Ks and S-1 filings.

[eloukas]

Couple things more, specifically about the PR:

1. Can you maybe link us to two to three filings of Form 144 (actual SEC/EDGAR URLs) to see how the website is structured and what kind of fields are there?
2. Note: The website does have some rare inconsistencies (I remember some "state of incorporation" fields were empty while crawling 10-k/10-q data). Have you checked multiple filings to verify that your code works in batch? I've never worked with such forms btw, sorry for "double-checking". Just wanna make sure that your code applies to the majority of the Form 144 filings, and not few of them (for example only of one company!)
3. Could you also post some screenshots of the output you have with the current proposed PR? Is anything changed in the metadata file btw ?

Many thanks once again for your interest!

[jsertx]

Hey!

Out of curiosity, could you tell us a bit more how you use form-144? Most of the research I've seen is directed towards 10-Ks, 10-Qs, 8-Ks and S-1 filings.

This form, also called Notice of Proposed Sale of Securities is used to indicate the intention to sell from an insider.

I will answer the other comments later.

[jsertx]

Hey, thanks to you (and the rest of the contributors) for this great project. I’m happy to do my bit :)> Couple things more, specifically about the PR:

1. Can you maybe link us to two to three filings of Form 144 (actual SEC/EDGAR URLs) to see how the website is structured and what kind of fields are there?

Re: GigaCloud, Berkshire Hathaway, Alibaba

2. Note: The website does have some rare inconsistencies (I remember some "state of incorporation" fields were empty while crawling 10-k/10-q data). Have you checked multiple filings to verify that your code works in batch? I've never worked with such forms btw, sorry for "double-checking". Just wanna make sure that your code applies to the majority of the Form 144 filings, and not few of them (for example only of one company!)

Re: I was not aware of those inconsistencies, though I have tested with the tickers below and It downloaded the txt files
["AAPL", "GCT", "GE", "BRK-A", "OXY", "TWLO", "BABA"]

3. Could you also post some screenshots of the output you have with the current proposed PR? Is anything changed in the metadata file btw ?

Re: The crawler properly downloads the txt files from the report, but I found two issues:

• col htm_file_link not filled.
• col State of Inc filled with weird values.

Let me get back to you in a few days after I fix those issues and test deeper.
By the way, If this PR gets merged I plan to also work on the extractor!

Best!