Hi,
I have downloaded all the data from
GAIN capital data:
http://ratedata.gaincapital.com/
however it seems there is only bid and ask price. There is no traded price.
Am I misunderstanding the forex market?
Also the time indicated would you know which time line ie Greenwich? USA Eastern?
Please forgive my stupidity as I am new to the currency market.
I was going to use this data to play around and design some strategies.
Many thanks in advance for your time
Stupid question about GAIN data
Moderator: moderators
Please add www.kreslik.com to your ad blocker white list.
Thank you for your support.
Thank you for your support.
-
michal.kreslik
- rank: 1000+ posts
- Posts: 1048
- Joined: Sat May 13, 2006 2:40 am
- Reputation: 36
- Location: Monte Carlo, Monaco
- Real name: Michal Kreslik
- Gender:
Hi, Toothfish,
I'm using the same data in my giant SQL Forex history machine database
You see it correctly: there are only Bid and Ask prices. And before 2004/4, there are many cases when the Bids and Asks are screwed up - intermingled, nonsensical values, etc. It takes a man to sift that data out, I can tell you.
The time used is ET (not the Extra Terrestrial, as it might sometimes seem when you look at the data, but Eastern Time).
Michal
I'm using the same data in my giant SQL Forex history machine database
You see it correctly: there are only Bid and Ask prices. And before 2004/4, there are many cases when the Bids and Asks are screwed up - intermingled, nonsensical values, etc. It takes a man to sift that data out, I can tell you.
The time used is ET (not the Extra Terrestrial, as it might sometimes seem when you look at the data, but Eastern Time).
Michal
-
Toothfish
- rank: <50 posts
- Posts: 14
- Joined: Fri Dec 08, 2006 9:09 am
- Reputation: 0
- Location: Sydney
- Real name: Andrew
- Gender:
Hi Michal,
Thankyou very much for your reply.
So how do you use the data from GAIN?
Isn't it pretty useless without the traded price?
I'm trying to get historical data on the forex to play around with and design some systems but don't want to pay thousands of dollars for data yet. I understand it's not going to be reliable if it's free.
Is there any source you could recommend.
By the way thankyou so much for your site.
Thankyou very much for your reply.
So how do you use the data from GAIN?
Isn't it pretty useless without the traded price?
I'm trying to get historical data on the forex to play around with and design some systems but don't want to pay thousands of dollars for data yet. I understand it's not going to be reliable if it's free.
Is there any source you could recommend.
By the way thankyou so much for your site.
-
michal.kreslik
- rank: 1000+ posts
- Posts: 1048
- Joined: Sat May 13, 2006 2:40 am
- Reputation: 36
- Location: Monte Carlo, Monaco
- Real name: Michal Kreslik
- Gender:
It is going to be reliable if you spend of couple of months developing the database and an application that makes sure the data is relevant
There is about 30% of duplicates, for instance, mainly in the older data. So you just have to make sure you remove those duplicate ticks. But at the same time you have to make sure you don't remove any unique ones. It gets tricky for a couple of reasons (one of them being there's only a second time stamp, so the ticks with the same second and Bid and Ask prices that really happened one after another need to be discerned from those that are duplicate), but it can be done.
I'm simply using the Bid prices for my further calculations. In Forex, there are only Bid and Ask prices. As far as I know, knowing which one of the two happened first doesn't provide you with any extra edge. By the way, I was able to fine tune my SQL database so that the average processing time for one tick in a statistical calculation (when the ticks are getting loaded sequentially) is about 4 microseconds.
I've moved this topic to the datafeed subforum and I left a shadow topic in the original beginners forum.
Michal
There is about 30% of duplicates, for instance, mainly in the older data. So you just have to make sure you remove those duplicate ticks. But at the same time you have to make sure you don't remove any unique ones. It gets tricky for a couple of reasons (one of them being there's only a second time stamp, so the ticks with the same second and Bid and Ask prices that really happened one after another need to be discerned from those that are duplicate), but it can be done.
I'm simply using the Bid prices for my further calculations. In Forex, there are only Bid and Ask prices. As far as I know, knowing which one of the two happened first doesn't provide you with any extra edge. By the way, I was able to fine tune my SQL database so that the average processing time for one tick in a statistical calculation (when the ticks are getting loaded sequentially) is about 4 microseconds.
I've moved this topic to the datafeed subforum and I left a shadow topic in the original beginners forum.
Michal
-
Toothfish
- rank: <50 posts
- Posts: 14
- Joined: Fri Dec 08, 2006 9:09 am
- Reputation: 0
- Location: Sydney
- Real name: Andrew
- Gender:
Hi Michal,
Thankyou for your beacon of light.
I have just come up with what I think is a cunning although compared to your SQL is pretty dumb.
To separate the date from the the time which if viewed in Excel gets put in the same column as there is no comma separating them
I used wordpad and do a findall and replace blank spaces with commas.
This allowed me to cut out the date, time and bid columns.
From there I have the arduous task of joining the years together.
This looks like it's going to take a few months and I have just cancelled any social activity off my diary.....which wasn't much anyway.
Again thankyou
It looks like I have found a new road and I need to start walking.
Thankyou for your beacon of light.
I have just come up with what I think is a cunning although compared to your SQL is pretty dumb.
To separate the date from the the time which if viewed in Excel gets put in the same column as there is no comma separating them
I used wordpad and do a findall and replace blank spaces with commas.
This allowed me to cut out the date, time and bid columns.
From there I have the arduous task of joining the years together.
This looks like it's going to take a few months and I have just cancelled any social activity off my diary.....which wasn't much anyway.
Again thankyou
It looks like I have found a new road and I need to start walking.
Please add www.kreslik.com to your ad blocker white list.
Thank you for your support.
Thank you for your support.
-
michal.kreslik
- rank: 1000+ posts
- Posts: 1048
- Joined: Sat May 13, 2006 2:40 am
- Reputation: 36
- Location: Monte Carlo, Monaco
- Real name: Michal Kreslik
- Gender:
-
Toothfish
- rank: <50 posts
- Posts: 14
- Joined: Fri Dec 08, 2006 9:09 am
- Reputation: 0
- Location: Sydney
- Real name: Andrew
- Gender:
Hi,
I'm still trying to make sense of the GAIN data. (2 years on) ( I have been trading equities and have just come round to looking at trading forex again)
In each week of data, the time seems to start from 00:00 but goes to 60:00 instead of 24:00hours. Could someone explain this please?
Many thanks
..... After a couple of good night's rest the only answer is data error
I think the data is fine after 2006.
I'm still trying to make sense of the GAIN data. (2 years on) ( I have been trading equities and have just come round to looking at trading forex again)
In each week of data, the time seems to start from 00:00 but goes to 60:00 instead of 24:00hours. Could someone explain this please?
Many thanks
..... After a couple of good night's rest the only answer is data error
I think the data is fine after 2006.
Last edited by Toothfish on Sun Feb 15, 2009 7:06 am, edited 1 time in total.
Please add www.kreslik.com to your ad blocker white list.
Thank you for your support.
Thank you for your support.