In my amazon ec2 instance, I have a cron job running python scripts... one of my scripts failed.
Error when running scraper happyfresh-lotte-en
'NoneType' object has no attribute 'json'
Traceback:
Traceback (most recent call last):
File "[login to view URL]", line 13, in run_and_report
[login to view URL](upload_to=s3path)
File "/home/ubuntu/engagespider/engagelib/scrapers/[login to view URL]", line 79, in run
[login to view URL]()
File "/home/ubuntu/engagespider/scrapers/[login to view URL]", line 28, in scrape
products = self.get_category_products(id)
File "/home/ubuntu/engagespider/scrapers/[login to view URL]", line 42, in get_category_products
response = self.get_json(endpoint, params=params)
File "/home/ubuntu/engagespider/engagelib/scrapers/[login to view URL]", line 42, in get_json
return self._get(url, params, _retry).json()
AttributeError: 'NoneType' object has no attribute 'json'
When bidding on this please tell me the latest version of python that amazon supports in the first sentence of your bid. If you don't then I know you are a robot bidder and don't understand English and will not consider your bid. I don't care if you copy pasted your experiences, if you can't read English and understand instructions then I will have a hard time communicating what I need from you.
Hello Sir,
I am expert who understands the value of time. I pride myself in my attention to detail. I am very hard working and aim to deliver in less time than quoted. I want to make you, my employer happy without changing my bid or playing games. If you are looking for a true Freelancer, I am the Right person for you. I am available almost 24-7 and am very responsive. I feel proud that I am a trusted Freelancer who pleases almost every single client. You can rest assure, your work will be delivered well in advance of others, with passion and accuracy. I guarantee you instant communication & responses when you need me. Why choose me? I think every client is the reason for my success. I only take projects which I am sure I can do quickly and at my FIRST BID. I promise to deliver 100% Satisfaction.I have more than 5 year of experience in Amazon Web Services, Linux, Python, Web Scraping. Please ping me for more discussion.
hello how are you
please see my title , i am so called scrape guru
do you have python source code
and i am sure I can fx the scdrape code as your reqruiement
please contact me and discuss more
thnks
Greetings,
I have read your all requirements carefully.
I have already made similar scrapper several time before, you may review profile for more information.
Most importantly, it's my routine job to scrap data for different projects. Looking forward to hear from you!
Greetings!
Amazon supports python 3.7 as latest version.
I have gone through your job post and found it very interesting as I have an experience of over a decade working on projects of similar stature. This task is relatively easier for me as I know the complete inside out of this. All I need is an opportunity and you would be provided with nothing less than exceptional results.
Would request you to come on the chat so that we may exchange some follow up questions.
BR,
Usama Ayaz
Amazon supports python3.7 as latest version.
Hello, I have 7 years experience in python, and your task looks pretty simple for me. Your problem looks like request is failed, so _get method returns None. I can fix it in a day
Hi,
As far as I know, Python 3 is supported by EC2. And one can always install newer versions or use a Docker Image as well.
As for me, I am a Software Developer and a Passionate Programmer. I can see that one of your scrapers failed to run and I can help you fix this. I use Python Daily at work and I understand deeply the ins and outs of the language.
I bid low because I am new to freelancing and I need to increase my visibility here. This is not too low, but not too high a rate either. I believe it is the right price I can offer you for this job.
I look forward to working with you.
Cheers and Regards,
Divij
Assume you want to hear 3.7 is supported by lambda (and boto) but if your cron is running off an ami it will support whatever.
Looks like it’s expecting something to jsonify from the endpoint but not receiving it. I’d be happy to take a look for you.
Amazon Lambda supports up to Python 3.7. Other then that you can use whatever you want on EC2 based on what you install.
Your stack trace looks like its likely working as intended, just that the web endpoint you are querying probably changed. All we likely need to do is figure out what’s going on with the target url and where that endpoint or equivalent may have moved.
