Dataset output formatting and bs4 method implementation

[navan0]

1.Dataset output formatting to CSV with question , answer,source_verified,manual_verified,url,final_answer
2.bs4 method implementation of URLs and other informations
3.crons

[blacksmithop]

Current progress:

Managed to collect question , source_verified (accepted question), url (share link for answer) and the answer itself.
Currently answer is basically a collection of code blocks from the accepted answer (only one considered at present) without the comments/ explanations it might have.
Possible Changes: Include Comments for better readability
Changes

[navan0]

looks good, including comment is not necessary. because comments might be messy and not fit for the dataset. for the final dataset, we have to manually go through all the data points. so we can refer the thread with url

I think you can make a PR after testing from your side. also, I'm assigned myself to do the dataset formatting and corn job. hope I can do it by tomorrow. then let's have a VC/discussion with the team

thanks

@GopikrishnanSasikumar