Topic: AWKCONVERTER, need another tutorial or convert from Ducascopy to FSB.

Hello Dear Popov, or Anyone:

I need help to create the work "The best quality data" or "the definitive guide top holy grail data"

I have problem with historical data and different time frames in FSB from my metatrader plataform.

I search 3 perfect's site data to download to FSB. But format is different.

I don't understand tutorial for AWKCONVERTER in the forum section. I need see in flash or video format or tutorial step by step to conver from 1 minute data to 5-15-60-240-1440 and 10080.
My metatrader plataform download data corrupted from this mode (http://forexsb.com/help/guide/metatrder_data)
I have download data in txt from dukascopy it's excellent  data quality, but I don't have convert date format and timeFrame to FSB.(http://www.dukascopy.com/freeApplets/exp/) format is different from dukascopy to FSB.

Another best historical data. http://ratedata.gaincapital.com/

Another site is http://www.forextester.com/data/datasources.html

I see one link with more information but not understand by my poor english (I'm speak spanish)
http://eareview.net/tick-data

Perfect tutorial is "how convert from DukasCopy to FSB data" or "how convert from gaincapital to FSB data"

Thank you, thank you, thank you very much, Jaime.

2 (edited by soladood 2010-08-04 02:17:22)

Re: AWKCONVERTER, need another tutorial or convert from Ducascopy to FSB.

jaimegue wrote:

Hello Dear Popov, or Anyone:

I need help to create the work "The best quality data" or "the definitive guide top holy grail data"

I have problem with historical data and different time frames in FSB from my metatrader plataform.

I search 3 perfect's site data to download to FSB. But format is different.

I don't understand tutorial for AWKCONVERTER in the forum section. I need see in flash or video format or tutorial step by step to conver from 1 minute data to 5-15-60-240-1440 and 10080.
My metatrader plataform download data corrupted from this mode (http://forexsb.com/help/guide/metatrder_data)
I have download data in txt from dukascopy it's excellent  data quality, but I don't have convert date format and timeFrame to FSB.(http://www.dukascopy.com/freeApplets/exp/) format is different from dukascopy to FSB.

Another best historical data. http://ratedata.gaincapital.com/

Another site is http://www.forextester.com/data/datasources.html

I see one link with more information but not understand by my poor english (I'm speak spanish)
http://eareview.net/tick-data

Perfect tutorial is "how convert from DukasCopy to FSB data" or "how convert from gaincapital to FSB data"

Thank you, thank you, thank you very much, Jaime.

I had the same problem as you - but i found there are many ways to convert the data - but the quickest way was from the link i put in my previous post....(http://eareview.net/tick-data). I will try to write a simple tutorial for you when i get home later tonight. wink  It's not so difficult.

Re: AWKCONVERTER, need another tutorial or convert from Ducascopy to FSB.

Guys, What is the problem? you don't need to convert data as Dukas supplies data in any timeframe just use the platform itself. You can open demo account here:
http://forexsb.com/forum/post/5284/#p5284 then use Jforex to download and save data in any timeframe you need.

Re: AWKCONVERTER, need another tutorial or convert from Ducascopy to FSB.

fxwinner wrote:

Guys, What is the problem? you don't need to convert data as Dukas supplies data in any timeframe just use the platform itself. You can open demo account here:
http://forexsb.com/forum/post/5284/#p5284 then use Jforex to download and save data in any timeframe you need.


i tried that but for some reason FSB didn't like the csv file direct from dukas.

I then removed the first line in the file as it said DATE, OPEN,CLOSE etc thinking that was upsetting the FSB - but no !

I then imported into the mt4 the dikas csv files - then exported them again to fsb - this works !

unless there was a corrupt download???? but then mt4 was able to read it...so im not sure whats going on here.

anyway - there was a way around this smile

Re: AWKCONVERTER, need another tutorial or convert from Ducascopy to FSB.

Please post 10lines of each file here,
1. Dukas original
2. Dukas which works with FSB.
And we work out the difference.
No need to work hard, trading should be fun :-P

Re: AWKCONVERTER, need another tutorial or convert from Ducascopy to FSB.

fxwinner wrote:

Please post 10lines of each file here,
1. Dukas original
2. Dukas which works with FSB.
And we work out the difference.
No need to work hard, trading should be fun :-P


ok

from dukascopy:

2008.07.31,04:00,1.55860,1.55880,1.55840,1.55880,2898
2008.07.31,04:15,1.55880,1.55920,1.55790,1.55790,4128
2008.07.31,04:30,1.55790,1.55840,1.55760,1.55810,4171
2008.07.31,04:45,1.55810,1.55840,1.55750,1.55770,3446
2008.07.31,05:00,1.55780,1.55910,1.55760,1.55860,9396
2008.07.31,05:15,1.55860,1.55860,1.55810,1.55850,2182
2008.07.31,05:30,1.55850,1.55880,1.55840,1.55860,3900
2008.07.31,05:45,1.55860,1.55960,1.55840,1.55960,8423
2008.07.31,06:00,1.55950,1.55990,1.55890,1.55980,10046
2008.07.31,06:15,1.55980,1.56110,1.55970,1.56090,8632


after mt4 export


2008.07.31,04:00,1.55860,1.55880,1.55840,1.55880,2898
2008.07.31,04:15,1.55880,1.55920,1.55790,1.55790,4128
2008.07.31,04:30,1.55790,1.55840,1.55760,1.55810,4171
2008.07.31,04:45,1.55810,1.55840,1.55750,1.55770,3446
2008.07.31,05:00,1.55780,1.55910,1.55760,1.55860,9396
2008.07.31,05:15,1.55860,1.55860,1.55810,1.55850,2182
2008.07.31,05:30,1.55850,1.55880,1.55840,1.55860,3900
2008.07.31,05:45,1.55860,1.55960,1.55840,1.55960,8423
2008.07.31,06:00,1.55950,1.55990,1.55890,1.55980,10046
2008.07.31,06:15,1.55980,1.56110,1.55970,1.56090,8632
smile

Re: AWKCONVERTER, need another tutorial or convert from Ducascopy to FSB.

The dukascopy original may have some unusual character. These are visible if you open the .csv in a text editor like Word or Notepad++, then look for a menu command of "View - Show Non-Printing Characters" or "View - Show Formatting Characters". (Every app has a different command.)
It could be something like Dukascopy original has "\r\n" for return and line feed, and FSB expects "\n" only for new line. Check the end of line delimiter, and check the beginning and end of the lines for a difference. These characters are tedious to look through, if you like post both of your files, I'll take a look too.

Re: AWKCONVERTER, need another tutorial or convert from Ducascopy to FSB.

good work krog, yes there is indeed difference you cannot see. Converting text files between Windows and UNIX http://linuxreviews.org/quicktips/txt_doc2unix/
Thanks for brining light on this Krog.
The best way to run it on Linux takes seconds to "convert".
I think it is clear now. no need to use MT4.
Use:
Jforex > Sed > FSB

Re: AWKCONVERTER, need another tutorial or convert from Ducascopy to FSB.

krog wrote:

The dukascopy original may have some unusual character. These are visible if you open the .csv in a text editor like Word or Notepad++, then look for a menu command of "View - Show Non-Printing Characters" or "View - Show Formatting Characters". (Every app has a different command.)
It could be something like Dukascopy original has "\r\n" for return and line feed, and FSB expects "\n" only for new line. Check the end of line delimiter, and check the beginning and end of the lines for a difference. These characters are tedious to look through, if you like post both of your files, I'll take a look too.


i was thinking the same - but thanks anyway !

I've only found this on dukascopy data - for now

Re: AWKCONVERTER, need another tutorial or convert from Ducascopy to FSB.

krog wrote:

The dukascopy original may have some unusual character. These are visible if you open the .csv in a text editor like Word or Notepad++, then look for a menu command of "View - Show Non-Printing Characters" or "View - Show Formatting Characters". (Every app has a different command.)
It could be something like Dukascopy original has "\r\n" for return and line feed, and FSB expects "\n" only for new line. Check the end of line delimiter, and check the beginning and end of the lines for a difference. These characters are tedious to look through, if you like post both of your files, I'll take a look too.


i was thinking the same - but i don't have much time to investigate properly !

I've only found this on dukascopy data - for now

Re: AWKCONVERTER, need another tutorial or convert from Ducascopy to FSB.

fxwinner wrote:

good work krog, yes there is indeed difference you cannot see. Converting text files between Windows and UNIX http://linuxreviews.org/quicktips/txt_doc2unix/
Thanks for brining light on this Krog.
The best way to run it on Linux takes seconds to "convert".
I think it is clear now. no need to use MT4.
Use:
Jforex > Sed > FSB


i don't use linux - not yet anyway !

but when I do I'll give it a go smile