1,738 karma · joined April 26, 2011
Services like Scrapingbee and ScraperAPI are serving quite good for such problems. I personally liked ScraperAPI for rendering dynamic websites due to the better response time.
Shameless Plug: In case if anyone is interested, long time back, I had written about it on my blog which you can read here[2]. Now you do not need to setup remote Chrome instance or anything. What all is required is to hit an API endpoint to fetch content from a dyanmic JS rendered websites.
[1] http://blog.adnansiddiqi.me/tag/scraping/
[2] http://blog.adnansiddiqi.me/scraping-dynamic-websites-using-...
- Writing ETLs
- Writing Scraping and Integration tools
- Web Development(Flask, DRF, FastAPI)
Recently I learned and wrote blog posts about FastAPI, have a look at http://blog.adnansiddiqi.me/tag/fastapi
------
Résumé/CV: http://adnansiddiqi.me/Resume2020.pdf
Blog: http://blog.adnansiddiqi.me
Email: kadnan@ gmail.com Github: https://github.com/kadnan
Well... Their content is being blocked on behalf of their own government while Pakistani social media content, especially Twitter content is being banned by Twitter India on behalf of Indian government. Recently my account was restricted when I RTed tweets of an Indian raising voice against farmer protest and once I got banned because I RTed a tweet about atrocities in IOK.
We also witnessed how parker app was banned and how many content is taken down on behalf of Many governments.
The point is, many counties are involved in such wicked activities one way or other regardless of who is pro democracy and who isn't.
Http://blog.adnansiddiqi.me/tag/fastapi
Mostly Python:
- Writing ETLs
- Writing Scraping and Integration tools
- Web Development
Recently I learned and wrote blog posts about FastAPI, have a look at http://blog.adnansiddiqi.me/tag/fastapi
My details given below:
Website: http://adnansiddiqi.me/
Resume: http://adnansiddiqi.me/Resume2020.pdf
Blog: http://blog.adnansiddiqi.me
Email: kadnan@gmail.com
Remote: Yes
Willing to relocate: No
Technologies: Working in multiple technologies but mostly now focusing on things around Python. I could write scrapers, automation tools, API integrations, Data Pipelines/ETL.
Résumé/CV: http://adnansiddiqi.me/CV2020.pdf
Blog: http://blog.adnansiddiqi.me
Email: kadnan @gmail
Though I am a generalist but especially interested and have experience in writing softwares in Python. I can help you in:
- Writing ETLs
- Writing Scraping and Integration tools
- Web Development
My details given below:
Website: http://adnansiddiqi.me/
Resume: http://adnansiddiqi.me/Resume2020.pdf
Blog: http://blog.adnansiddiqi.me
Email: kadnan@gmail.com
- Join some RnD lab where I can usr my dev experience to solve science related problems. I can make website, write automation tools in python and data analysis.
PS: if anyone read this and willing to discuss some opportunity then mail me at kadnan@gmail.com Check my site given in profile to learn about me.
Technologies: Web Development(Laravel, Flask, Django). ETL(Airflow, Bonobo, Spark). Web Scraping(Beautifulsoup, Selenium, Scrapy).
How can I be helpful? You could hire me for the following but not specific to it:
Code/System optimization: I could help to improve your system/website performance by checking code, Db Queries and Db itself. For websites, I can help to see what requests are unnecessary and how to minimize them and Db management.
Web Development: I am quite comfortable in Laravel and Flask but could also work in Django.
Product Development: I could take care of entire product development cycle.
ETL/Optimization: I can help in Data Scraping, writing data/ETL pipelines and automation tools to make your life easier.
Code Janitor/System Optimization: I can help you to improve both front/backend system speed, refactoring old code. Porting old code to new version. I am mainly focusing on PHP at the moment but could deal with Laravel as well.
Website: http://adnansiddiqi.me/
Resume: http://adnansiddiqi.me/Resume2020.pdf
Blog: http://blog.adnansiddiqi.me
Email: kadnan@gmail.com
Remote: Yes
Willing to relocate: It depends on opportunity.
Technologies: Python, PHP, MySQL and a few others
Resume: http://adnansiddiqi.me/Resume2020.pdf
Email: kadnan @ gmail
So unlike previous hiring posts I am trying my luck into something different, a code/system janitor and optimizer.
Background:- Lately, I got a chance to work on PHP-based systems that were on old code and not optimized(front/back/DB). A project I am about to finish was porting old php5 code to php7 and XSS vulnerabilities. It also includes a bit of optimizing queries and making the system efficient.
I am currently focusing on PHP related work whether it is checking of vulnerabilities, optimizing (front|back) end or refactoring. So drop me and email and we go from there.
Remember, poor quality systems code trillions in US only[1]
[1] - https://bitbar.com/blog/how-much-did-poor-quality-software-c...
Hope HN management will set a black bar in his honor.