* extend the test and fix fp16 typo.

* guard reset params with z3 enabled check.

---------
Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com>

* fix lora fuse unfuse in hybrid_engine

* fix name

* fix typo

* remove empty lines

* Update gptj.py

* add lora test-case + fix gptneo implementation

* try to fix format

* try to accelerate testcase by reducing max length

* reduce test runtime

* Fix bloom / gpt-neox and add test for bloom

* fix CI + fix issue in engine

---------
Co-authored-by: NJeff Rasley <jerasley@microsoft.com>
Co-authored-by: NAmmar Ahmad Awan <ammar.awan@microsoft.com>
Co-authored-by: NOlatunji Ruwase <olruwase@microsoft.com>