New LLM providers and more

LLM Support

• Added support for Gemini 1.x series. (2.x models are not exposed via APIs as of this release)

Dependencies:

• Changes to handle latest of Ollama

• Upgraded OpenAI SDK to avoid known issues.

• Pinned lib versions to avoid any breaks.

• Regression Tested few more rounds

Known issues:
The "getting started" notebook breaks as the pre-installed dependencies in colab , we are working on it.

Stable release

• Tested few more rounds
• Added Safety nets
• Updated samples for usage

Beta releaase

Readme has all the details.

• Support for English Routers.
• Tested on Ollama llama3.1 and OpenAI gpt4x
• Few experimental features for tweaking.