Forums Register Login

Reading data from web sites

+Pie Number of slices to send: Send
I am trying to read data from web sites.
I seem to have an error rate of about 0.1%.
Is this typical? What is the method/procedure to correct this type of error? Should multiple reads be done until a consistent value is obtained?

John
+Pie Number of slices to send: Send
Define "error". What happens when there is an error?
+Pie Number of slices to send: Send
What does "read data from a web site" mean? What kind of client? What kind of data?
+Pie Number of slices to send: Send
I'm reading Stock prices from Yahoo and TSP fund prices from thrift savings plan, Thrift Saving Plan Share Prices.
The error is that the historic stock, or fund, price changes since the last time I read it.

For example, I have previously read 19 Sep 2005 G Fund as "11.0100", and that value has previously passed a unit test of the type stock.getprice(date). However, that unit test just failed.

This may not be the best example, but in other cases, I have downloaded different prices for historical dates.

Code deleted, not isolated to the problem.
+Pie Number of slices to send: Send
Generally speaking, the error is of the type that a different value is obtained for a fund at some point in the past. But, I always get a value, not just gibberish or garbled text.
1
+Pie Number of slices to send: Send
That's at least 500% more code than I think is reasonable to ask of people to try and make sense of :-)

Are the two files that give different results at different times identical? At a quick glance, it seems that you're scraping a web page, and web pages differ over time. If they' re not identical, then examining the differences will give you an idea of how to generalize your code so that it can deal with said differences.
+Pie Number of slices to send: Send
I need to do more work to isolate the problem.
Is that a spider in your hair? Here, threaten it with this tiny ad:
a bit of art, as a gift, the permaculture playing cards
https://gardener-gift.com


reply
reply
This thread has been viewed 873 times.
Similar Threads
data loss upon 'post'
web services for scraping/extracting data from travel/airline sites
Liquid Data and Web Application
I have Internet connection in my computer; it is meaning that “I can access all the websites
JESS and ECommerce?
More...

All times above are in ranch (not your local) time.
The current ranch time is
Mar 28, 2024 18:36:21.