1b3bfb2e7f
found root cause.
2021-05-20 11:50:15 +07:00
48210170e7
wrap with is not empty
2021-05-20 11:49:25 +07:00
082fb11bbe
Avoid having error `cannot set a frame with no defined index and a scalar`
2021-05-20 01:54:48 +07:00
ef4d1c24d7
Merge pull request #4941 from brookmiles/fix-stoploss-above-candle
...
prevent backtest stoploss trade price being set above candle high
2021-05-19 06:20:35 +02:00
7a9853bfe1
Fix "Too many open Files" exception
2021-05-18 20:39:55 +02:00
36eba0f110
Don't use "r+" memmap, but "r2
2021-05-17 21:05:48 +02:00
6aa574fa2b
Convert ROI result to proper json object
...
closes #4952
2021-05-17 20:58:50 +02:00
4f968b4a6f
Merge pull request #4926 from rokups/rk/misc-fixes
...
Two fixes
2021-05-15 15:11:07 +02:00
2d5f465f1b
Fix protections being loaded multiple times for first strategy when backtesting.
2021-05-15 13:37:03 +03:00
29fed37df3
Fix exception when few pairs with no data do not result in aborting backtest.
...
Exception is triggered by backtesting 20210301-20210501 range with BAKE/USDT pair (binance). Pair data starts on 2021-04-30 12:00:00 and after adjusting for startup candles pair dataframe is empty.
Solution: Since there are other pairs with enough data - skip pairs with no data and issue a warning.
Exception:
```
Traceback (most recent call last):
File "/home/rk/src/freqtrade/freqtrade/main.py", line 37, in main
return_code = args['func'](args)
File "/home/rk/src/freqtrade/freqtrade/commands/optimize_commands.py", line 53, in start_backtesting
backtesting.start()
File "/home/rk/src/freqtrade/freqtrade/optimize/backtesting.py", line 502, in start
min_date, max_date = self.backtest_one_strategy(strat, data, timerange)
File "/home/rk/src/freqtrade/freqtrade/optimize/backtesting.py", line 474, in backtest_one_strategy
results = self.backtest(
File "/home/rk/src/freqtrade/freqtrade/optimize/backtesting.py", line 365, in backtest
data: Dict = self._get_ohlcv_as_lists(processed)
File "/home/rk/src/freqtrade/freqtrade/optimize/backtesting.py", line 199, in _get_ohlcv_as_lists
pair_data.loc[:, 'buy'] = 0 # cleanup from previous run
File "/home/rk/src/freqtrade/venv/lib/python3.9/site-packages/pandas/core/indexing.py", line 692, in __setitem__
iloc._setitem_with_indexer(indexer, value, self.name)
File "/home/rk/src/freqtrade/venv/lib/python3.9/site-packages/pandas/core/indexing.py", line 1587, in _setitem_with_indexer
raise ValueError(
ValueError: cannot set a frame with no defined index and a scalar
```
2021-05-15 13:37:03 +03:00
2eac23a15f
if stoploss price is above the candle high, set it to candle open instead. this can occur if stoploss had previously been reached but the sell was prevented by `confirm_trade_exit`
2021-05-15 15:38:51 +09:00
5e73195b30
Use linux lineseperator at all times
2021-05-15 07:01:32 +02:00
ecee42f561
Read pickle file in mmap mode
2021-05-13 20:13:04 +02:00
1055862bc0
Extract data-load + dump from hyperopt
...
(Reduces memory-usage as the dataframes go out of scope)
2021-05-12 21:15:01 +02:00
24a1d5a96f
Change default hyperopt-name to be shorter
2021-05-12 19:06:13 +02:00
3cbe40875d
read hyperopt results from pickle or json
2021-05-12 06:06:30 +02:00
06bf1aa274
Store epochs as json per line
2021-05-12 05:58:25 +02:00
7398ea88e0
Change optimize_reports to convert dates to string earlier
2021-05-11 20:37:49 +02:00
92186d89a2
Add some changes to strategytemplate
2021-05-09 09:56:36 +02:00
8d8c782bd0
Slice dataframe in backtesting, preventing access to rows past current time.
2021-05-08 18:40:49 +03:00
f1eb653545
Fix strategy protections not being loaded in backtesting.
2021-05-08 10:29:47 +03:00
1b01ad6f85
Make exchange parameter optional and do not use it as parameter in backtesting.
2021-05-08 10:29:47 +03:00
4b6cd69c81
Add test for no-exchange dataprovider
2021-05-08 10:29:47 +03:00
d344194b36
Fix dataprovider in hyperopt.
2021-05-08 10:29:47 +03:00
6fb4d83ab3
Fix dataprovider in hyperopt.
2021-05-08 10:29:47 +03:00
cdfa6adbe5
Store pair datafrmes in dataprovider for backtesting.
2021-05-08 10:29:47 +03:00
d34da3f981
Revert "Add dataframe parameter to custom_stoploss() and custom_sell() methods."
...
This reverts commit 595b8735f8
2021-05-08 10:29:47 +03:00
513be11fd9
Fix hyperopt output
...
closes #4892
2021-05-07 20:23:11 +02:00
554f5f14b6
Raise exception if no data is left
2021-05-07 06:41:15 +02:00
4f529fe424
Don't use Arrow to get min/max backtest dates
2021-05-06 19:43:14 +02:00
da574e4e69
Small style fixes
2021-05-03 06:30:41 +02:00
fc110ea418
Support csv export for new and old versions
2021-05-02 20:41:45 +02:00
287b43e999
Output strategy results including non-optimized parameters
2021-05-02 11:30:53 +02:00
d069ad43d8
Small reformatting in hyperopt
2021-05-02 11:01:26 +02:00
8ee0b0d8e8
Store not optimized parameters (if applicable)
2021-05-02 10:46:04 +02:00
46f0f66039
Keep dimensions stored in hyperopt class
...
There is no point in regenerating them and it will cause some
overhead as all space classes will be recreated for every epoch.
2021-05-02 09:48:37 +02:00
ced5cc7ce2
Don't recalculate min/max date - they won't change between epochs
2021-05-02 09:46:27 +02:00
ecdfb6e5ed
Fix output of % for new format
2021-05-02 09:46:27 +02:00
881cba336a
Show backtesting result in hyperopt-show
2021-05-02 09:46:27 +02:00
420e75af65
Extract show_backtest_result for one strategy
2021-05-02 09:46:27 +02:00
97478abb9d
Move format explanation string to HyperoptTools
2021-05-02 09:46:27 +02:00
f2e182002d
Simplify calling backtesting by returning the proper result
2021-05-02 09:46:27 +02:00
e2e1d34828
Extract stake_currency param from hyperopt-explanationstring
2021-05-02 09:46:27 +02:00
6aaaad29d7
Use backtesting output for hyperopt results
2021-05-02 09:46:27 +02:00
545cba7fd8
Refactor optimize_report
...
we should not calculate non-daily statistics in the daily stats method
2021-05-02 09:46:27 +02:00
9994fce577
Extract generation of report for one strategy to it's own method
2021-05-02 09:46:27 +02:00
b125c975c7
Rename strategy_comparison method
2021-05-02 09:46:27 +02:00
ac2e1eb3d7
Don't import joblib for regular strategies
2021-05-02 08:44:16 +02:00
1cb430f59b
Remove encoding specifics, gitattributes to echeckout as utf8
2021-05-01 17:41:40 +02:00
e0ca3c014c
Don't completely remove encode/decode
2021-05-01 17:12:48 +02:00
30da307d13
Remove encode/decode for hyperopt
2021-05-01 17:01:52 +02:00
e381df9098
extract has_space to Hyperopt-Tools
2021-05-01 16:36:35 +02:00
7c8a367442
Update docs to not promote stoploss / take-profit
2021-04-28 20:36:06 +02:00
2061162d79
Convert trade-opendate to python datetime
2021-04-26 20:01:13 +02:00
98f6fce2ec
Use correct sell reason in case of custom sell reason.
2021-04-25 09:48:40 +03:00
595b8735f8
Add dataframe parameter to custom_stoploss() and custom_sell() methods.
2021-04-25 09:48:40 +03:00
1aad128d85
Support returning a string from custom_sell() and have it recorded as custom sell reason.
2021-04-25 09:48:40 +03:00
88f26971fa
Use defaultdict for backtesting
2021-04-24 19:15:09 +02:00
f12e002686
Merge pull request #4775 from freqtrade/fix_wallet_unlimited
...
Fix wallet unlimited
2021-04-24 15:54:06 +02:00
df16fbd742
Add "dataload complete" message to backtest + hyperopt
2021-04-23 19:22:41 +02:00
d8c8a8d8c2
Remvoe pointless arguments from get_trade_stake_amount
2021-04-21 20:01:10 +02:00
cfa9315e2a
Prevent out of candle ROI sells
2021-04-20 20:29:53 +02:00
ce870bbcf7
Use 3 decimals for ROI space
2021-04-15 21:38:20 +02:00
52c482cecf
Convert trailing and roi defaults to skdecimal
2021-04-14 20:36:34 +02:00
e820814809
Default-stoploss-hyperopt should use decimal space, nto real
2021-04-14 20:32:34 +02:00
9804e20114
Don't use _set_value for autoOpt-Spaces
2021-04-10 09:53:48 +02:00
34e47db18d
Test SKDecimal space
2021-04-09 22:15:24 +02:00
5f67400649
Add SKDecimal Space
2021-04-09 21:58:15 +02:00
7b2a0d46cb
Fix typo
2021-04-05 15:38:25 +02:00
b470672dfd
Merge pull request #4596 from rokups/rk/hyper-strategy
...
Support for creating auto-hyperoptable strategies.
2021-04-05 13:55:32 +02:00
bd5e1c5096
Merge pull request #4660 from rextea/order_pairlist_results
...
Sort pair lists by total profit
2021-04-04 19:47:33 +02:00
9e56f6d4eb
Sort pair lists by total profit
2021-04-04 01:19:38 +03:00
9d4b5cc6bb
Fix typo
2021-04-03 19:56:20 +02:00
41cb2a6451
Merge branch 'develop' into pr/rokups/4596
2021-04-03 17:00:37 +02:00
6555454bd2
Remove more ticker_interval occurances
2021-04-03 16:54:47 +02:00
ea43d5ba85
Implement DecimalParameter and rename FloatParameter to RealParameter.
2021-04-02 17:08:16 +03:00
5acdc9bf42
Fix type errors by converting all hyperopt methods to instance methods
2021-04-01 06:47:23 +02:00
5e5b11d4d6
Split "enabled" to "load" and "optimize" parameters.
2021-03-31 12:31:28 +03:00
2869d5368d
Allow edge to use dynamic pairlists
...
closes #4298
2021-03-30 20:20:24 +02:00
89bbfd2324
Remove candle_count from dataframe before backtesting
...
closes #3754
2021-03-29 20:26:54 +02:00
8022386404
Type custom_hyperopt
2021-03-27 18:00:07 +01:00
786ddc6a91
remove unused imports
2021-03-27 10:47:33 +01:00
40f5c7853e
[SQUASH] Add a way to temporarily disable a parameter (excludes from parameter loading/hyperopt) and print parameter values when executed.
2021-03-26 16:56:24 +02:00
fd45dfd894
[SQUASH] Make skopt imports optional.
2021-03-26 16:56:24 +02:00
11689100e7
[SQUASH] Fix exception when HyperOpt nested class is not defined.
2021-03-26 16:56:24 +02:00
e9f0babe8a
[SQUASH] Use HyperStrategyMixin as part of IStrategy interface.
2021-03-26 16:56:24 +02:00
2d13e5fd50
[SQUASH] Oopsies.
2021-03-26 16:56:24 +02:00
bb89e44e19
[SQUASH] Address PR comments.
...
* Split Parameter into IntParameter/FloatParameter/CategoricalParameter.
* Rename IHyperStrategy to HyperStrategyMixin and use it as mixin.
* --hyperopt parameter is now optional if strategy uses HyperStrategyMixin.
* Use OperationalException() instead of asserts.
2021-03-26 16:56:24 +02:00
0a205f52b0
Optional support for defining hyperopt parameters in a strategy file and reusing common hyperopt/strategy parts.
2021-03-26 16:56:24 +02:00
8da7d5c009
Merge pull request #4594 from rextea/add_confirm_exit_enter_tade_to_backtesting
...
Add confirm_trade_exit and confirm_trade_entry to backtesting
2021-03-25 20:26:56 +01:00
292ea8c1d0
Update backtesting.py
2021-03-25 09:34:33 +01:00
0ca95aa0c2
Change rate to acctual close rate
2021-03-25 10:25:25 +02:00
ec15610bff
Fix isort issue
2021-03-24 19:21:07 +01:00
f51f4b1817
Add confirm_trade_exit and confirm_trade_entry to backtesting
2021-03-23 10:35:46 +02:00
dc4ea604dd
Add confirm_trade_exit and confirm_trade_entry to backtesting
2021-03-23 10:19:16 +02:00
eb5d69dcd4
Add confirm_trade_exit and confirm_trade_entry to backtesting
2021-03-23 10:12:08 +02:00
6856963aef
Add confirm_trade_exit and confirm_trade_entry to backtesting
2021-03-23 10:09:41 +02:00
76ca3c219f
extract result-printing from hyperopt class
2021-03-17 20:45:15 +01:00
b57c150654
Final balance should include forcesold pairs
2021-03-14 09:48:40 +01:00
cd8d9f2930
Merge pull request #4534 from rokups/patch-1
...
Provide access to strategy instance from hyperopt class.
2021-03-13 17:14:47 +01:00
5e872273d1
Provide access to strategy instance from hyperopt class.
2021-03-13 15:13:42 +02:00
d1acc8092c
Improve backtest performance
2021-03-13 10:17:14 +01:00
0db5c9746f
Merge pull request #4454 from freqtrade/backtest_compound_speed
...
Backtest compound, wallet, ...
2021-03-10 10:07:40 +01:00
4b550dab17
Always reset fake-databases
...
Otherwise results may stick around for the next strategy
2021-03-08 19:40:29 +01:00
0b81b58d28
Use pandas.values.tolist instead of itertuples
...
speeds up backtesting
closes #4494
2021-03-07 11:28:54 +01:00
4532222010
Fixed line length in HyperOpt for new name
...
Fixed line length errors and multiple f strings to facilitate strategy being added in the name
2021-03-05 13:16:49 -06:00
345f7404e9
Add strategy name to HyperOpt results filename
...
This just extends the HyperOpt result filename by adding the strategy name. This allows analysis of HyperOpt results folder with no additional necessary context. An alternative idea would be to expand the result dict, but the additional static copies are non value added.
2021-03-05 12:56:11 -06:00
731ab5d2a7
Fix too long line errors
2021-03-05 19:22:57 +01:00
bc05d03126
Make best / worst day absolute
2021-03-05 19:21:09 +01:00
0968ecc1af
added "Median profit" column to hyperopt -> export-csv
2021-03-04 17:27:04 +01:00
078b77d41b
Fix crash when using unlimited stake and no trades are made
2021-03-02 16:12:22 +01:00
55a315be14
fix: avg_stake_amount should not be `NaN` if df is empty
2021-03-02 13:38:55 +01:00
2083cf6ddf
Fix mypy errors introduced by Arrow update
2021-03-01 08:57:57 +01:00
9cb37409fd
Explicitly convert starting-balance to float
2021-02-28 09:56:29 +01:00
b2e9295d7f
Small stylistic fixes
2021-02-27 19:57:42 +01:00
324b9dbdff
Simplify wallet code
2021-02-27 10:33:25 +01:00
98f3142b30
Improve handling of backtesting params
2021-02-27 09:33:00 +01:00
fc256749af
Add test for backtesting _enter_trade
2021-02-27 09:33:00 +01:00
53a57f2c81
Change some types
...
Fix types of new model object
2021-02-27 09:33:00 +01:00
03eb23a4ce
2 levels of Trade models, one with and one without sqlalchemy
...
Fixes a performance issue when backtesting with sqlalchemy, as that
uses descriptors for all properties.
2021-02-27 09:33:00 +01:00
394a6bbf2a
Fix some type errors
2021-02-27 09:33:00 +01:00
52acacbed5
Check min-trade-stake in backtesting
2021-02-27 09:33:00 +01:00
f04f07299c
Improve backtesting metrics
2021-02-27 09:33:00 +01:00
7913166453
Improve performance by updating wallets only when necessary
2021-02-27 09:33:00 +01:00
f367375e5b
ABS drawdown should show wallet high and low values
2021-02-27 09:33:00 +01:00
0d2f877e77
Use absolute drawdown calc
2021-02-27 09:32:59 +01:00
74fc4bdab5
Shorten debug log
2021-02-27 09:32:59 +01:00
72f21fc5ec
Add trade-volume metric
2021-02-27 09:32:59 +01:00
35e6a9ab3a
Backtest-reports should calculate total gains based on starting capital
2021-02-27 09:32:59 +01:00
8d61a26382
Allow dynamic stake for backtesting and hyperopt
2021-02-27 09:32:59 +01:00
e4abe902fc
Enable compounding for backtesting
2021-02-27 09:32:59 +01:00
0faa6f84dc
Improve Wallet logging disabling for backtesting
2021-02-27 09:32:59 +01:00
081b9be45c
use get_all_locks to get locks for backtest result
2021-02-27 09:32:59 +01:00
712d503e6c
Use sell-reason value in backtesting, not the enum object
2021-02-27 09:32:59 +01:00
b5177eadab
Extract close method for exchange
2021-02-27 09:32:59 +01:00
4ce4eadc23
remove only ccxt objects when hyperopting
2021-02-27 09:32:59 +01:00
9361aa1c95
Add wallets to backtesting
2021-02-27 09:32:59 +01:00
11b20d6932
Add config to hyperopt_loss_function documentation
2021-02-17 07:04:29 +01:00
eff0d46ea1
Merge pull request #4375 from flomerz/pass_processed_data
...
pass data and config to loss function
2021-02-16 20:06:50 +01:00
009a447d8a
Adjust documentation for new parameter in loss functions
2021-02-16 19:51:09 +01:00
3e06cd8b3a
pass data and config to loss function
2021-02-16 10:11:33 +01:00
5c263c7ffd
add backtesting results abs profit min/abs profit max, to get a better view if a strategy has a enough money to succeed
2021-02-14 19:41:12 +01:00
e7acee7904
Improve coin value output by rounding coin specific
2021-02-13 16:05:56 +01:00
072abde9b7
Introduce round_coin_value to simplify coin rounding
2021-02-13 16:05:35 +01:00
c659150d9f
Also print trade_duration in seconds to json
2021-01-25 19:42:34 +01:00
62e43539c9
Limit max_open_trades to maximum available pairs
...
closes #4008
2021-01-24 19:59:54 +01:00
789a980a30
Fix tests for new export format
2021-01-24 19:42:32 +01:00
deb8432d33
Streamline trade to dataframe conversion
2021-01-24 08:58:41 +01:00
8ee264bc59
Don't use profit_percent for backtesting results anymore
2021-01-24 08:58:41 +01:00
48977493bb
Backtesting does not need to convert to BacktestResult object
2021-01-24 08:58:41 +01:00
7c80eeea95
Add use_custom_stoploss to optimize_report
2021-01-19 22:51:12 +01:00
0b65fe6afe
Capture backtest start / end time
2021-01-14 19:09:25 +01:00
9147106259
call bot_loop_start() in backtesting to allow setup-code to run
2021-01-14 19:09:25 +01:00
baa1142afa
Use preprocessed to get min/max date in hyperopt
2021-01-14 19:09:21 +01:00
9d4cdcad10
Extract backtesting of one strategy
2021-01-14 19:04:42 +01:00
f3de0dd3eb
Fix support for protections in hyperopt
...
closes #4208
2021-01-14 06:53:40 +01:00
63a579dbab
Add sell_profit_offset parameter
...
Allows defining positive offsets before enabling the sell signal
2021-01-11 19:30:25 +01:00
f11fd2fee1
Sort imports
2020-12-23 17:00:02 +01:00
67193bca3d
Move pairlists to be a plugin submodule
2020-12-23 16:54:35 +01:00
266031a6be
Disallow PerformanceFilter for backtesting
...
closes #4072
2020-12-16 19:24:47 +01:00
f047297995
Improve wording, fix bug
2020-12-07 15:48:06 +01:00
5849d07497
Export locks as part of backtesting
2020-12-07 11:39:01 +01:00
bb51da8297
Fix slow backtest due to protections
2020-12-07 11:39:01 +01:00
75a5161650
Support multis-strategy backtests with protections
2020-12-07 11:39:01 +01:00
a3f9cd2c26
Only load protections when necessary
2020-12-07 11:39:01 +01:00
e2d15f4082
Add parameter to enable protections for backtesting
2020-12-07 11:39:01 +01:00
32189d27c8
Disable output from plugins in backtesting
2020-12-07 11:39:01 +01:00
9f34aebdaa
Allow closing trades without message
2020-12-07 11:39:01 +01:00
b606936eb7
Make changes to backtesting to incorporate protections
2020-12-07 11:39:01 +01:00
e40d97e05e
Small formatting improvements
2020-11-28 17:52:29 +01:00
5d3f59df90
Add best / worst trade
2020-11-28 17:45:56 +01:00
a00f852cf9
Add best / worst pair to summary statistics
2020-11-28 17:37:10 +01:00
a47d8dbe56
Small refactor, avoiding duplicate calculation of profits
2020-11-28 11:35:29 +01:00
730c9ce471
Add Max_open_trades to summary metrics
2020-11-24 06:57:26 +01:00
887d78171c
Merge pull request #3857 from freqtrade/arrow_deprecation_timestamp
...
Convert timestamp to int_timestamp for all arrow occurances
2020-11-02 16:40:43 +01:00
e73203acb8
FIx bug with dmmp
2020-11-01 10:51:07 +01:00
7a092271c5
Merge branch 'develop' into arrow_deprecation_timestamp
2020-10-20 20:01:54 +02:00
cf2ae788d7
Convert backtesting rows to Tuples for performance gains
2020-10-18 17:16:57 +02:00
5d3a67d324
Don't debug-log during backtesting.
...
Even though log-messages are surpressed, calling "debug" will always
have to do something.
2020-10-18 16:38:16 +02:00
b80a219d03
Improve typehints for backtesting
2020-10-18 16:35:23 +02:00
380e6628e0
Merge branch 'develop' into feat/backtest_speedup_serialize
2020-10-18 16:19:04 +02:00
2591a34db4
Don't use arrow objects for backtesting
2020-10-18 16:18:52 +02:00
ecddaa663b
Convert timestamp to int_timestamp for all arrow occurances
2020-10-13 06:24:01 +02:00
23bad8fd9f
Rename DefahltHyperoptLoss function to ShortTradeDurHyperOptLoss
2020-10-10 14:22:29 +02:00
23278e52db
remove obsolete logging statements
2020-10-08 20:22:59 +02:00
e8f2c09f08
Extract handling of left open trades to seperate method
2020-10-08 20:11:45 +02:00
52502193c4
Backtesting should not double-loop for sell signals
2020-10-07 20:59:05 +02:00
40b61bbfe3
Adjust trailing-stop to be python compliant
2020-10-05 07:44:12 +02:00
cb74c9bcde
Fix hyperopt output
2020-10-03 13:27:06 +02:00
6977ffdbf9
Merge branch 'develop' into isort_config
2020-09-28 20:21:55 +02:00
253b7b763e
Apply isort to freqtrade codebase
2020-09-28 19:40:46 +02:00
c42a924df8
Load latest file
2020-09-27 16:50:42 +02:00
ff96cf154c
Keep hyperopt result history
2020-09-27 16:33:26 +02:00
b736691e0e
Remove hyperopt --continue
2020-09-27 16:18:28 +02:00
bb27b236ce
Remove unused arguments
2020-09-26 14:55:12 +02:00
ff3e2641ae
generate_backtest_stats must take config options from the strategy
...
config
as a strategy can override certain options.
2020-09-25 20:47:37 +02:00
378f03a5b1
Add relevant parameters to stored backtest result
2020-09-25 06:37:40 +02:00
6674285b12
Merge pull request #3756 from allenday/patch-1
...
prettify hyperopt console output
2020-09-19 17:43:05 +02:00
f0d7f18cf9
Pad wins / draws / losses for hyperopt with spaces instead of 0's
2020-09-19 17:32:22 +02:00
ec01f20bf8
Add ratio to sell reason stats
2020-09-16 20:27:28 +02:00
Kamontat Chantrachirathumrong
Matthias
Rokas Kupstys
Brook Miles
rextea
Rokas Kupstys
Patrick Weber
raoulus
Joe Schr
Florian Merz
Florian Reitmeir