The theoretical Assessment demonstrates that EDIS displays decreased suboptimality compared to only using online info or immediately reusing offline facts. EDIS is actually a plug-in technique and may be combined with current procedures in offline-to-on the web RL setting. By utilizing EDIS to off-the-shelf techniques Cal-QL and IQL, we notice a no