<?xml version="1.0" encoding="utf-8"?>
<feed xmlns="http://www.w3.org/2005/Atom">
	<title type="html"><![CDATA[Forex Software — OOS question]]></title>
	<link rel="self" href="https://forexsb.com/forum/feed/atom/topic/5534/" />
	<updated>2015-09-02T15:26:19Z</updated>
	<generator>PunBB</generator>
	<id>https://forexsb.com/forum/topic/5534/oos-question/</id>
		<entry>
			<title type="html"><![CDATA[Re: OOS question]]></title>
			<link rel="alternate" href="https://forexsb.com/forum/post/31374/#p31374" />
			<content type="html"><![CDATA[<p>In a way, everything is over optimized.....&nbsp; best test is the real market or having the expert perform on other instruments.</p>]]></content>
			<author>
				<name><![CDATA[Blaiserboy]]></name>
				<uri>https://forexsb.com/forum/user/2491/</uri>
			</author>
			<updated>2015-09-02T15:26:19Z</updated>
			<id>https://forexsb.com/forum/post/31374/#p31374</id>
		</entry>
		<entry>
			<title type="html"><![CDATA[Re: OOS question]]></title>
			<link rel="alternate" href="https://forexsb.com/forum/post/31271/#p31271" />
			<content type="html"><![CDATA[<div class="quotebox"><cite>Popov wrote:</cite><blockquote><p>Yes, I understand. You can achieve that when you do not use OOS. It will work on 99% of the cases.</p><p>Summary:</p><p>If you want the Acceptance Criteria to be fulfilled for the partial (first 80%) of the data, use OOS.<br />If you want the Criteria to be fulfilled for the partial data (80%) and full data (100%) with one calculation, do not use OOS.</p></blockquote></div><p>With the second case we will more likely get an over-optimized strategy <img src="https://forexsb.com/forum/img/smilies/smile.png" width="15" height="15" alt="smile" /> anyway.. thanks for replying</p>]]></content>
			<author>
				<name><![CDATA[dedok3000]]></name>
				<uri>https://forexsb.com/forum/user/8450/</uri>
			</author>
			<updated>2015-08-26T08:48:10Z</updated>
			<id>https://forexsb.com/forum/post/31271/#p31271</id>
		</entry>
		<entry>
			<title type="html"><![CDATA[Re: OOS question]]></title>
			<link rel="alternate" href="https://forexsb.com/forum/post/31269/#p31269" />
			<content type="html"><![CDATA[<p>Yes, I understand. You can achieve that when you do not use OOS. It will work on 99% of the cases.</p><p>Summary:</p><p>If you want the Acceptance Criteria to be fulfilled for the partial (first 80%) of the data, use OOS.<br />If you want the Criteria to be fulfilled for the partial data (80%) and full data (100%) with one calculation, do not use OOS.</p>]]></content>
			<author>
				<name><![CDATA[Popov]]></name>
				<uri>https://forexsb.com/forum/user/2/</uri>
			</author>
			<updated>2015-08-26T05:21:03Z</updated>
			<id>https://forexsb.com/forum/post/31269/#p31269</id>
		</entry>
		<entry>
			<title type="html"><![CDATA[Re: OOS question]]></title>
			<link rel="alternate" href="https://forexsb.com/forum/post/31263/#p31263" />
			<content type="html"><![CDATA[<div class="quotebox"><cite>Popov wrote:</cite><blockquote><p>There are very few cases where a strategy that fulfills the criteria on full data set doesn&#039;t fulfill the criteria on the partial data. So you can easily safe the time for the first calculation.</p><p>Imagine you have criteria for max DD and max consecutive losses.</p><p>If you have max DD of $200 for the full data set, it is not possible to have greater DD for the partial data. The same is for the max consecutive losses. If you have 6 consecutive losses for the full set, it is not possible to have more for the smaller set. </p><p>However the opposite is fully possible. For example to have 6 consecutive losses for the partial set, but after loading the full data, the losses to become 8.</p></blockquote></div><p>I mean that on the 80% of data the strategy may be extremely over-optimized so when you check it on the 100% data the balance chart drops down at those last 20% and this is actually a very often case... until you check &quot;use default indicators values&quot; of course.</p><p>So I have to go to the Editor of each strategy and check if the chart drops down at the end (over-optimized) or not (probably good strategy) <img src="https://forexsb.com/forum/img/smilies/smile.png" width="15" height="15" alt="smile" /> and my idea was to save time by making a new feature like &quot;double acceptance criteria check&quot; option <img src="https://forexsb.com/forum/img/smilies/smile.png" width="15" height="15" alt="smile" /> Hope you understand what I mean.</p>]]></content>
			<author>
				<name><![CDATA[dedok3000]]></name>
				<uri>https://forexsb.com/forum/user/8450/</uri>
			</author>
			<updated>2015-08-25T21:35:08Z</updated>
			<id>https://forexsb.com/forum/post/31263/#p31263</id>
		</entry>
		<entry>
			<title type="html"><![CDATA[Re: OOS question]]></title>
			<link rel="alternate" href="https://forexsb.com/forum/post/31262/#p31262" />
			<content type="html"><![CDATA[<p>There are very few cases where a strategy that fulfills the criteria on full data set doesn&#039;t fulfill the criteria on the partial data. So you can easily safe the time for the first calculation.</p><p>Imagine you have criteria for max DD and max consecutive losses.</p><p>If you have max DD of $200 for the full data set, it is not possible to have greater DD for the partial data. The same is for the max consecutive losses. If you have 6 consecutive losses for the full set, it is not possible to have more for the smaller set. </p><p>However the opposite is fully possible. For example to have 6 consecutive losses for the partial set, but after loading the full data, the losses to become 8.</p>]]></content>
			<author>
				<name><![CDATA[Popov]]></name>
				<uri>https://forexsb.com/forum/user/2/</uri>
			</author>
			<updated>2015-08-25T21:01:08Z</updated>
			<id>https://forexsb.com/forum/post/31262/#p31262</id>
		</entry>
		<entry>
			<title type="html"><![CDATA[Re: OOS question]]></title>
			<link rel="alternate" href="https://forexsb.com/forum/post/31261/#p31261" />
			<content type="html"><![CDATA[<div class="quotebox"><cite>Popov wrote:</cite><blockquote><div class="quotebox"><blockquote><p>generator to generate strategies that fulfill the acceptance criteria INCLUDING the OOS part.</p></blockquote></div><p>Switch off OOS and you&#039;ll get it.</p></blockquote></div><p>No <img src="https://forexsb.com/forum/img/smilies/smile.png" width="15" height="15" alt="smile" /> it&#039;s different.. I mean it should find a strategy that fulfills the acceptance criteria on 80% of data, then add the missing 20% and check for acceptance criteria AGAIN. And push the strategy to repo only after that.</p>]]></content>
			<author>
				<name><![CDATA[dedok3000]]></name>
				<uri>https://forexsb.com/forum/user/8450/</uri>
			</author>
			<updated>2015-08-25T20:54:00Z</updated>
			<id>https://forexsb.com/forum/post/31261/#p31261</id>
		</entry>
		<entry>
			<title type="html"><![CDATA[Re: OOS question]]></title>
			<link rel="alternate" href="https://forexsb.com/forum/post/31260/#p31260" />
			<content type="html"><![CDATA[<p>Actually, when the generator finishes it shows the stats calculated on the full data set.</p>]]></content>
			<author>
				<name><![CDATA[Popov]]></name>
				<uri>https://forexsb.com/forum/user/2/</uri>
			</author>
			<updated>2015-08-25T20:44:25Z</updated>
			<id>https://forexsb.com/forum/post/31260/#p31260</id>
		</entry>
		<entry>
			<title type="html"><![CDATA[Re: OOS question]]></title>
			<link rel="alternate" href="https://forexsb.com/forum/post/31259/#p31259" />
			<content type="html"><![CDATA[<div class="quotebox"><blockquote><p>generator to generate strategies that fulfill the acceptance criteria INCLUDING the OOS part.</p></blockquote></div><p>Switch off OOS and you&#039;ll get it.</p>]]></content>
			<author>
				<name><![CDATA[Popov]]></name>
				<uri>https://forexsb.com/forum/user/2/</uri>
			</author>
			<updated>2015-08-25T20:38:23Z</updated>
			<id>https://forexsb.com/forum/post/31259/#p31259</id>
		</entry>
		<entry>
			<title type="html"><![CDATA[Re: OOS question]]></title>
			<link rel="alternate" href="https://forexsb.com/forum/post/31258/#p31258" />
			<content type="html"><![CDATA[<p>I mean.. that would be a nice option in generator to generate strategies that fulfill the acceptance criteria INCLUDING the OOS part.</p>]]></content>
			<author>
				<name><![CDATA[dedok3000]]></name>
				<uri>https://forexsb.com/forum/user/8450/</uri>
			</author>
			<updated>2015-08-25T20:30:35Z</updated>
			<id>https://forexsb.com/forum/post/31258/#p31258</id>
		</entry>
		<entry>
			<title type="html"><![CDATA[Re: OOS question]]></title>
			<link rel="alternate" href="https://forexsb.com/forum/post/31257/#p31257" />
			<content type="html"><![CDATA[<p>And one more question - what about acceptance criteria? The generator applies it to the 80% part of data only?</p>]]></content>
			<author>
				<name><![CDATA[dedok3000]]></name>
				<uri>https://forexsb.com/forum/user/8450/</uri>
			</author>
			<updated>2015-08-25T20:29:12Z</updated>
			<id>https://forexsb.com/forum/post/31257/#p31257</id>
		</entry>
		<entry>
			<title type="html"><![CDATA[Re: OOS question]]></title>
			<link rel="alternate" href="https://forexsb.com/forum/post/31256/#p31256" />
			<content type="html"><![CDATA[<div class="quotebox"><cite>Popov wrote:</cite><blockquote><div class="quotebox"><cite>dedok3000 wrote:</cite><blockquote><p>Oh.. actually looks like I got what you mean.. So the generator just uses 80% of the data set in data horizon and then I see the chart with 100% data?</p></blockquote></div><p>Yes. It is correct.</p><p>It uses the partial data only during the generation. After finishing, it loads all data and calculates the full stats that you see on the Editor tab hence no green zone in the Editor (full data calculation).</p><p>During the generation, it sends stats to the Collections repo. The collections has only the partial data (first 80%). This is the reason why the collection doesn&#039;t show the green zone.</p></blockquote></div><p>Oh... but my idea was to show this green zone in the editor because it&#039;s useful to check when the OOS period starts on the chart...</p>]]></content>
			<author>
				<name><![CDATA[dedok3000]]></name>
				<uri>https://forexsb.com/forum/user/8450/</uri>
			</author>
			<updated>2015-08-25T20:28:00Z</updated>
			<id>https://forexsb.com/forum/post/31256/#p31256</id>
		</entry>
		<entry>
			<title type="html"><![CDATA[Re: OOS question]]></title>
			<link rel="alternate" href="https://forexsb.com/forum/post/31255/#p31255" />
			<content type="html"><![CDATA[<div class="quotebox"><cite>dedok3000 wrote:</cite><blockquote><p>Oh.. actually looks like I got what you mean.. So the generator just uses 80% of the data set in data horizon and then I see the chart with 100% data?</p></blockquote></div><p>Yes. It is correct.</p><p>It uses the partial data only during the generation. After finishing, it loads all data and calculates the full stats that you see on the Editor tab hence no green zone in the Editor (full data calculation).</p><p>During the generation, it sends stats to the Collections repo. The collections has only the partial data (first 80%). This is the reason why the collection doesn&#039;t show the green zone.</p>]]></content>
			<author>
				<name><![CDATA[Popov]]></name>
				<uri>https://forexsb.com/forum/user/2/</uri>
			</author>
			<updated>2015-08-25T20:24:27Z</updated>
			<id>https://forexsb.com/forum/post/31255/#p31255</id>
		</entry>
		<entry>
			<title type="html"><![CDATA[Re: OOS question]]></title>
			<link rel="alternate" href="https://forexsb.com/forum/post/31254/#p31254" />
			<content type="html"><![CDATA[<p>Oh.. actually looks like I got what you mean.. So the generator just uses 80% of the data set in data horizon and then I see the chart with 100% data?</p>]]></content>
			<author>
				<name><![CDATA[dedok3000]]></name>
				<uri>https://forexsb.com/forum/user/8450/</uri>
			</author>
			<updated>2015-08-25T19:54:32Z</updated>
			<id>https://forexsb.com/forum/post/31254/#p31254</id>
		</entry>
		<entry>
			<title type="html"><![CDATA[Re: OOS question]]></title>
			<link rel="alternate" href="https://forexsb.com/forum/post/31253/#p31253" />
			<content type="html"><![CDATA[<div class="quotebox"><cite>Popov wrote:</cite><blockquote><p>No way. OOS data and stats are out of sample. If you see them, they are not OOS <img src="https://forexsb.com/forum/img/smilies/smile.png" width="15" height="15" alt="smile" /></p><p>It is simple. There is absolutely no way to calculate stats on OOS (missing / not yet existing) data.<br />Once the data is available, it is not more OOS. Therefore we always calculate in sample.</p><p>Probably you want to calculate stats with less data. Later to calculate stats with more data and the program to mark the zone from where the new data starts.</p><p>It is possible only if the program makes two calculations every time when calculates the strategy. Such feature is not available in the current version.</p></blockquote></div><p>Well... looks like the only way to do what I want is to generate a strategy using cut data horizon and then recalculate it on extended data horizon..</p>]]></content>
			<author>
				<name><![CDATA[dedok3000]]></name>
				<uri>https://forexsb.com/forum/user/8450/</uri>
			</author>
			<updated>2015-08-25T19:51:40Z</updated>
			<id>https://forexsb.com/forum/post/31253/#p31253</id>
		</entry>
		<entry>
			<title type="html"><![CDATA[Re: OOS question]]></title>
			<link rel="alternate" href="https://forexsb.com/forum/post/31251/#p31251" />
			<content type="html"><![CDATA[<p>No way. OOS data and stats are out of sample. If you see them, they are not OOS <img src="https://forexsb.com/forum/img/smilies/smile.png" width="15" height="15" alt="smile" /></p><p>It is simple. There is absolutely no way to calculate stats on OOS (missing / not yet existing) data.<br />Once the data is available, it is not more OOS. Therefore we always calculate in sample.</p><p>Probably you want to calculate stats with less data. Later to calculate stats with more data and the program to mark the zone from where the new data starts.</p><p>It is possible only if the program makes two calculations every time when calculates the strategy. Such feature is not available in the current version.</p>]]></content>
			<author>
				<name><![CDATA[Popov]]></name>
				<uri>https://forexsb.com/forum/user/2/</uri>
			</author>
			<updated>2015-08-25T19:34:59Z</updated>
			<id>https://forexsb.com/forum/post/31251/#p31251</id>
		</entry>
</feed>
