Dukascopy Support Board
http://www.dukascopy.com/swiss/english/forex/jforex/forum/

Spikes in historical data and missing data
http://www.dukascopy.com/swiss/english/forex/jforex/forum/viewtopic.php?f=85&t=50608
Page 1 of 1

Author:  nicofr0707 [ Fri 03 Jan, 2014, 17:52 ]
Post subject:  Spikes in historical data and missing data

Hello,

There are very messy charts using 1 minute in historical data making backtests a pain.
Here an example in CADJPY, a lot of spikes. EURAUD misses a whole lot of
data before the 1st may 2007.

I know there is no tick data before 2007, but how far in the past can we backtest
with minute bars on all majors and crosses ? (EUR, GBP, USD, JPY, AUD, NZD, CHF)

How to avoid those annoying spikes ? Any better tester config ?
Please see the following example and GUI parameters :

The spikes a crushing my stoploss and takeprofit prices, making results inaccurate.

Thanks.

Image

Author:  nicofr0707 [ Sat 11 Jan, 2014, 14:08 ]
Post subject:  Re: Spikes in historical data and missing data

Please can someone give me some information ?

Thanks.

Author:  tcsabina [ Mon 13 Jan, 2014, 10:48 ]
Post subject:  Re: Spikes in historical data and missing data

From time to time, the historical data is being updated (even data for the past years, not just the latest data). If clearing the platform cache (which deletes the downloaded price data) is not 'solving' these spikes, the only thing you can do is the keep asking Support to fix it :).

Author:  nicofr0707 [ Wed 15 Jan, 2014, 17:52 ]
Post subject:  Re: Spikes in historical data and missing data

Hi, yeah I often delete the cache. So I'll keep asking, I guess...

Support please ? ;)

Author:  Platform Support [ Fri 17 Jan, 2014, 09:35 ]
Post subject:  Re: Spikes in historical data and missing data

We would take care of it asap. Sorry for inconvenience.

Author:  nicofr0707 [ Mon 20 Jan, 2014, 09:48 ]
Post subject:  Re: Spikes in historical data and missing data

OK thanks for the support.

Please check all Instruments, it is not only CAD/JPY that has issues.

How far in the past should we be able to backtest accurately with with a 1min feed ? with tick data ?

Please, tell us when the problems are resolved so we can reload the cache.

Thanks.

Author:  nicofr0707 [ Wed 19 Feb, 2014, 09:44 ]
Post subject:  Re: Spikes in historical data and missing data

Hi Support,

It took me almost 3 days to re-downloaded all the cache files since 2007 but I see nothing has changed.

When do you plan to provide us with an accurate history cache ?

Kind regards.

Author:  Ding1 [ Thu 14 Jan, 2016, 03:16 ]
Post subject:  Re: Spikes in historical data and missing data

Some quick python data wizardry revealed that historical data is full of such irregularities.
We all assume this data comes from the trading servers, but that doesn't seem to be the case.
Can we expect Dukascopy to ever provide accurate data?

  Page 1 of 1