Topic: In sample - what is it
Can you explain to me what that option and what it is used for?
marek
Create and Test Forex Strategies
You are not logged in. Please login or register.
Forex Software → Forex Strategy Builder Professional → In sample - what is it
Can you explain to me what that option and what it is used for?
marek
Out of sample testing (OOS) reduces the risk of curve fitting. For more information: http://forexsb.com/wiki/fsb/manual/generator
OOS stands for Out of Sample.
The idea of OOS is to test and to see the performance of the strategy against unknown data. If the strategy performs well on this unknown (OOS) data, it means that the risk of over-optimization is lower.
If you set "In sample", FSB will use the full data set for backtesting. It means that no OOS is performed.
If you set 25%, FSB will EXCLUDE the newest 25% of the data bars and will calculate the test on the first 75% of the data. When the program finishes generating or optimizing, it will reload the full data set and will calculate again.
The green part of the chart is the OOS data zone. It is the most important part of the chart because the program was not used it for optimizing. It is also called future testing on historical data. It also simulates the "trading" part.
Google for "forex Out of sample" for more info.
Very important to read this article to minimize over-optimization:
http://forexsb.com/forum/topic/4788/pseudomathematics-and-financial-charlatanism/
Dear Popov
Can you please elucidate if this is also valid for Pro?
"OOS option does not influence on the “Limitations”. Even if OOS is in use, the Generator evaluates the limitations criteria for the full data series."
http://forexsb.com/wiki/fsb/manual/generator
I believe this shouldn't happen. It's not statistically sound.
Cheers
Nuno
FSB Pro performs "real" out of sample. It actually cuts the data set and generates the strategy on this subset. All Acceptance Criteria are real. Generator loads the full set only after finishing the generating process.
You can see this on the Input Parameters.
That is the best to use for example 25% OOS - and after optimization graph on a green field must climb to the top. Yes?
Forex Software → Forex Strategy Builder Professional → In sample - what is it
Powered by PunBB, supported by Informer Technologies, Inc.