feat: cron job to parse nippon mutual funds

[shivamsouravjha]

• We can get the information from the page of

curl 'https://mf.nipponindiaim.com/investor-service/downloads/factsheet-portfolio-and-other-disclosures' \
  -H 'accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7' \
  -H 'accept-language: en-GB,en-US;q=0.9,en;q=0.8' \
  -H 'cache-control: max-age=0' \
  -H 'priority: u=0, i' \
  -H 'sec-ch-ua: "Google Chrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"' \
  -H 'sec-ch-ua-mobile: ?0' \
  -H 'sec-ch-ua-platform: "macOS"' \
  -H 'sec-fetch-dest: document' \
  -H 'sec-fetch-mode: navigate' \
  -H 'sec-fetch-site: none' \
  -H 'sec-fetch-user: ?1' \
  -H 'upgrade-insecure-requests: 1' \

in that page we can search for the text of Monthly portfolio for the month end and inside the get the href tag and download the xlsx file, once that xlsx is parsed it has name of all mutual funds and the the sheet they;re in https://mf.nipponindiaim.com/InvestorServices/FactsheetsDocuments/Reliance-Monthly-Portfolios-30-04-2019.xls

we can upload each sheet as a new file in cloudinary with its name(not uuid but name of mutual fund) and also store the name in mongo collection.

This can help us in a lot of features to come!!

[cu8code]

Hey would love to help!

[shivamsouravjha]

sure feel free to pick the same!

[cu8code]

There are multiple files in https://mf.nipponindiaim.com/investor-service/downloads/factsheet-portfolio-and-other-disclosures going back to September 2012

Q.1 Do we need to get all the XLS files ?
Q.2 What are the data that we need to extract and store ?

When I try to enter https://mf.nipponindiaim.com/InvestorServices/FactsheetsDocuments I get asked to enter username and password!

Q.3 What are the info we need to extract from https://mf.nipponindiaim.com/InvestorServices/FactsheetsDocuments/Reliance-Monthly-Portfolios-30-04-2019.xls

[shivamsouravjha]

1. we need all those files (would help us track the percentage holding of a stock for a longer duration.
2. basically we need that xlsx file in our cloudinary bucket and their entry in our mongo collection (currently we need a regular data scrapper, we would want that data stored making sure we don't store in same cloudinary bucket again)

try the link of https://mf.nipponindiaim.com/investor-service/downloads/factsheet-portfolio-and-other-disclosures and it will have all the necessary link.

the current https://www.stocksight.online/ has an upload button you can try uploading the xlsx here...as of now we won't be needing any data we just need a durable way of extract every month the portfolio. (we can will use this data in later part of project)