thank you for your hint using streamerapi.

i am not whether it helps. i found some c code for buffering with libcurl. here we go:

//Declaration bla bla
#include
#include “/usr/include/curl/curl.h”
#include “/usr/include/curl/easy.h”
using namespace std;

//Hello I am a function pointer!
int writer(char *data, size_t size, size_t nmemb, string *buffer){
/* See: http://curl.haxx.se/libcurl/c/getinmemory.html */
int result = 0;
if(buffer != NULL) {
buffer -> append(data, size * nmemb);
result = size * nmemb;
}
return result;
}

//writer is used here
string download_data_to_buffer(string strUrl){
/* (A) Variable Declaration */
CURL *curl; /* That is the connection, see: curl_easy_init */
string buffer; /* See: CURLOPT_WRITEDATA */
curl = curl_easy_init(); /* (B) Initilise web query */
/* (C) Set Options of the web query
* See also: http://curl.haxx.se/libcurl/c/curl_easy_setopt.html */
if (curl){
curl_easy_setopt(curl, CURLOPT_URL, strUrl.c_str() );
curl_easy_setopt(curl, CURLOPT_FAILONERROR, 1);
curl_easy_setopt(curl, CURLOPT_WRITEFUNCTION, writer); /* Function Pointer “writer” manages the required buffer size */
curl_easy_setopt(curl, CURLOPT_WRITEDATA, &buffer ); /* Data Pointer &buffer stores downloaded web content */
}
curl_easy_perform(curl); /* (D) Fetch the data */
curl_easy_cleanup(curl); /* (E) Close the connection */
return buffer;
}

compile with

g++ -c -I/usr/include/curl piipapo.c
g++ -o testtest piipapo.o -L/usr/lib/libcurl -lcurl

I am not sure if it helps you.

http://finance.yahoo.com/charts?s=IBM#chart1:symbol=ibm;range=1d;charttype=line;crosshair=on;ohlcvalues=0;logscale=on;source=undefined

I’m not able to get anything returned from trying the URIs you mentioned, so I can’t explore my idea, but do you think it might work if {“open” : “1265380231″, “close” : “1265403631″} (In the URI of course) were the same timestamp?

So theoretically I should be able to access the Bid price from 9:43 am for IBM from the historical data.

in general this looks perfectly fine to me. But there were a few things which troubled me with my implementation (mainly buffering). In short you have 3 buffers to look at.
First one is easy – curl: Curl provides a parameter which disables the buffering (–no-buffer).
Second buffer is the pipe: On that end I can only speak for the linux implementation of pipes. You can’t control pipe buffering. All pipes are controlled by the kernel and there is no way to influence that behavior.
Third buffer is the stdin buffer for your streamreader. In C you can influence that buffer size, so I think this should also be possible in C++ too.

For me solving the problems with the first and third buffer solved the problem. The kernel never did anything unexpected which prevents this from functioning (again – linux kernel).

Finally, the reason why google.com always works is easy. The site google.com has a relatively fixed size and after downloading this the stream will be closed. After the close all buffers will be flushed and you see all the data in you application. On the other hand, if this stream is not closed, the flush can take some time. Without explicit flushing (as explained above) the stream flushed very irregularly (several minutes) on my machine. So as you can see, without minimizing buffers it can take quite a while.

I hope this helps (If not just post again, maybe I can get a simple c++ application running on a Windows machine just to get more insight)

Sorry about that, a bit tired…

I am on windows 2000, doing something like
curl URL|test.exe

Apparently, I am not getting anything from curl because the stream is continuous. However, I can get some thing if I do
curl “http://streamerapi.finance.yahoo.com/streamer/1.0?s=JAVA,MSFT&k=l10&callback=parent.yfs_u1f&mktmcb=parent.yfs_mktmcb&gencallback=parent.yfs_gencb”|test.exe

Any help will be great.

#include “stdafx.h”
#include
#include
#include
#include
#include

using namespace std;

int main(int argc, char* argv[])
{
ofstream myfile;

string s;
string buf;
do {
myfile.open (“example.txt”);
cin >> buf;
s.append(buf);
myfile << buf;
myfile.close();
} while (!cin.eof());

return 0;
}

Here is the error message when I tried on Sunday

D:\curl>curl -s -o – -N http://streamerapi.finance.yahoo.com/streamer/1.0?s=JAVA
,MSFT&k=l10&callback=parent.yfs_u1f&mktmcb=parent.yfs_mktmcb&gencallback=parent.
yfs_gencb
‘k’ is not recognized as an internal or external command,
operable program or batch file.
‘callback’ is not recognized as an internal or external command,
operable program or batch file.
‘mktmcb’ is not recognized as an internal or external command,
operable program or batch file.
‘gencallback’ is not recognized as an internal or external command,
operable program or batch file.

js: uncaught JavaScript runtime exception: ReferenceError: “readline” is not defined.

I’m not familiar with java so I was wondering if there is another function I can use instead of readline.

BTW: I’m running Mac OSX

Thanks

I tried it with ^DJI and the url works fine – here what I entered:
curl -s -o – -N ‘http://streamerapi.finance.yahoo.com/streamer/1.0?s=^DJI&k=l10&callback=parent.yfs_u1f&mktmcb=parent.yfs_mktmcb&gencallback=parent.yfs_gencb’

But there is a catch here. The javascript used to extract the information has the symbol hardcoded, so this needs to be refit.

For me I have an improved script, which does this a more generic way:
yfs_u1f = function(tmp) {
try{
var source = tmp.toSource();
var name = source.slice(source.indexOf(“‘”)+1,source.lastIndexOf(“‘”));
var price = ((new Number(tmp[name].a00) + new Number(tmp[name].b00))/2);
if(! isNaN(price) )
{
print(“insert into realtime(symbol,date,price) values(‘”+name+”‘,current_timestamp,”+price+”);”);
}
}catch(ex){}
};

-> But even in this version, the values requested, are hardcoded (in my version ask and bid). My tryouts to bring this into one generic c application failed so far, because the yahoo JSON code isn’t a hundret percent compatible with the JSON standard.