Berkeley Function Calling Leaderboard Updates (v1.2) #869

ShishirPatil announced in Announcements

ShishirPatil
Jan 5, 2025
Maintainer

Highlights

🏆 Berkeley Function Calling Leaderboard V3 with Multi-step and Multi-turn function call evaluation

What's Changed

[BFCL] Package the Codebase by @devanshamin in [BFCL] Package the Codebase #565
Added python script named as raft_local.py to raft directory to run script completely locally using HF models by @himanshushukla12 in Added python script named as raft_local.py to raft directory to run script completely locally using HF models #605
RAFT Enhancements: Improved robustness, logging, checkpointing, threading, Llama support, Azure auth and eval by @cedricvidal in RAFT Enhancements: Improved robustness, logging, checkpointing, threading, Llama support, Azure auth and eval #604
Fix/merge commit Added python script named as raft_local.py to raft directory to run script completely locally using HF models #605 and RAFT Enhancements: Improved robustness, logging, checkpointing, threading, Llama support, Azure auth and eval #604 by @ShishirPatil in Fix/merge commit #605 and #604 #609
Fix issue [BFCL] ModuleNotFoundError after Restructuring in Commit 70d6722: Incorrect Import Paths #614: [BFCL] ModuleNotFoundError after commit 70d6722 by @kobe0938 in Fix issue #614: [BFCL] ModuleNotFoundError after commit 70d6722 #615
Fix some bugs in test case prompts/ground truths by @aw632 in Fix some bugs in test case prompts/ground truths #608
[BFCL] Dataset and Possible Answer Fix by @HuanzhiMao in [BFCL] Dataset and Possible Answer Fix #600
Add Salesforce xLAM model series by @zuxin666 in Add Salesforce xLAM model series #616
Update gemini_handler.py to better handle NL+FC model output by @vandyxiaowei in Update gemini_handler.py to better handle NL+FC model output #617
[BFCL] Fix Decoding Issue in Nvidia Handler by @HuanzhiMao in [BFCL] Fix Decoding Issue in Nvidia Handler #623
[BFCL] Fix Llama Handler by @HuanzhiMao in [BFCL] Fix Llama Handler #626
[BFCL] add MadeAgents/Hammer-7b handler by @linqq9 in [BFCL] add MadeAgents/Hammer-7b handler #627
[BFCL] Refactor Model Handler into OSS and Proprietary Components by @devanshamin in [BFCL] Refactor Model Handler into OSS and Proprietary Components #612
[BFCL] Hot Fix to Remove Extra Parameters for NoAPIKeyError by @HuanzhiMao in [BFCL] Hot Fix to Remove Extra Parameters for NoAPIKeyError #636
fix: bug for glm prompt format by @zhangch-ss in fix: bug for glm prompt format #638
[BFCL] Add New Model o1-preview-2024-09-12 and o1-mini-2024-09-12 by @HuanzhiMao in [BFCL] Add New Model o1-preview-2024-09-12 and o1-mini-2024-09-12 #635
[BFCL] BFCL v3 by @HuanzhiMao in [BFCL] BFCL v3 #644
removed unnecessary comments in raft/raft_local.py by @himanshushukla12 in removed unnecessary comments in raft/raft_local.py #654
[BFCL] Chore: Separate Change Log. by @HuanzhiMao in [BFCL] Chore: Separate Change Log. #648
[BFCL] Bug Fix inference_single_turn_FC function for base_handler by @HuanzhiMao in [BFCL] Bug Fix inference_single_turn_FC function for base_handler #656
[BFCL] Bug Fix parse_nested_value function for model_handler utils by @VishnuSuresh27 in [BFCL] Bug Fix parse_nested_value function for model_handler utils #660
added Phi-3 handlers by @AndyChenYH in added Phi-3 handlers #640
Update agent arena frontend and evals by @NithikYekollu in Update agent arena frontend and evals #666
[BFCL] Speed Up Locally-hosted Model Inference Process by @HuanzhiMao in [BFCL] Speed Up Locally-hosted Model Inference Process #671
[BFCL] Fix Hanging Inference for OSS Models on GPU Platforms by @HuanzhiMao in [BFCL] Fix Hanging Inference for OSS Models on GPU Platforms #663
[BFCL] Add gemini-1.5-pro-002, gemini-1.5-pro-002-FC, gemini-1.5-pro-001, gemini-1.5-pro-001-FC, gemini-1.5-flash-002, gemini-1.5-flash-002-FC, gemini-1.0-pro-002, gemini-1.0-pro-002-FC by @HuanzhiMao in [BFCL] Add gemini-1.5-pro-002, gemini-1.5-pro-002-FC, gemini-1.5-pro-001, gemini-1.5-pro-001-FC, gemini-1.5-flash-002, gemini-1.5-flash-002-FC, gemini-1.0-pro-002, gemini-1.0-pro-002-FC #658
[BFCL] Add Llama-3.2-1B-Instruct, Llama-3.2-3B-Instruct, Llama-3.1-8B-Instruct, Llama-3.1-70B-Instruct by @HuanzhiMao in [BFCL] Add Llama-3.2-1B-Instruct, Llama-3.2-3B-Instruct, Llama-3.1-8B-Instruct, Llama-3.1-70B-Instruct #657
[BFCL] Add ToolACE handler for BFCL-v3 by @XuHwang in [BFCL] Add ToolACE handler for BFCL-v3 #653
Add Qwen handler and fix mean_latency calculation error for OSS models by @zhangch-ss in Add Qwen handler and fix mean_latency calculation error for OSS models #642
update README.md by @leosun12 in update README.md #669
[BFCL] Chore: Various Improvements and Adjustments by @HuanzhiMao in [BFCL] Chore: Various Improvements and Adjustments #673
[BFCL] Chore: Refactor File Path Handling and Automate apply_function_credential_config.py by @HuanzhiMao in [BFCL] Chore: Refactor File Path Handling and Automate apply_function_credential_config.py #675
docs: update README.md by @eltociear in docs: update README.md #676
[BFCL-v3] Multi-Turn Possible Answer Order Change by @Fanjia-Yan in [BFCL-v3] Multi-Turn Possible Answer Order Change #679
update hammer handler and add Hammer2.0 model by @linqq9 in update hammer handler and add Hammer2.0 model #667
[BFCL] Chore: Improve Multi Turn Error Logs by @HuanzhiMao in [BFCL] Chore: Improve Multi Turn Error Logs #689
Update google-cloud-aiplatform dependency by @jieru-hu in Update google-cloud-aiplatform dependency #677
add minicpm3 4b by @Cppowboy in add minicpm3 4b #633
[BFCL-v2] Dataset and Possible Answer Fix by @HuanzhiMao in [BFCL-v2] Dataset and Possible Answer Fix #661
[BFCL] Add Gemma-2 models by @jacovkim in [BFCL] Add Gemma-2 models #696
add a basic bfcl command-line interface by @mattf in add a basic bfcl command-line interface #621
Fixing BFCL-v3 multi-turn apps by @virginie-do in Fixing BFCL-v3 multi-turn apps #701
[BFCL v1] Update Executable Ground Truth for REST Category by @CharlieJCJ in [BFCL v1] Update Executable Ground Truth for REST Category #708
[BFCL v1] Rephrase Question for Better Clarity for Java & JavaScript Categories by @HuanzhiMao in [BFCL v1] Rephrase Question for Better Clarity for Java & JavaScript Categories #709
[BFCL] Add SGLang Backend Support for OSS Local Inference by @hnyls2002 in [BFCL] Add SGLang Backend Support for OSS Local Inference #587
(typo):I've made some corrections to your repository to improve clarity by @PrathameshSPawar in (typo):I've made some corrections to your repository to improve clarity #713
docs: Centered the Image by @bhargavshirin in docs: Centered the Image #680
[BFCL] Multi Turn Dataset and Possible Answer Fix by @HuanzhiMao in [BFCL] Multi Turn Dataset and Possible Answer Fix #683
[BFCL] Chore: Separate out Func Doc for Multi-Turn Categories by @HuanzhiMao in [BFCL] Chore: Separate out Func Doc for Multi-Turn Categories #717
[BFCL] Multi Turn Dataset and Possible Answer Fix (Base Category) by @HuanzhiMao in [BFCL] Multi Turn Dataset and Possible Answer Fix (Base Category) #719
[BFCL] Multi Turn Dataset Fix (Function Doc) by @HuanzhiMao in [BFCL] Multi Turn Dataset Fix (Function Doc) #722
[BFCL] Multi Turn Dataset Fix (Base Category) by @HuanzhiMao in [BFCL] Multi Turn Dataset Fix (Base Category) #723
[BFCL] Multi Turn Pipeline Robustness Patch by @HuanzhiMao in [BFCL] Multi Turn Pipeline Robustness Patch #724
[BFCL] Small typo in variable name in travel_booking.py by @daanaea in [BFCL] Small typo in variable name in travel_booking.py #731
[BFCL] Patch [BFCL] Multi Turn Pipeline Robustness Patch #724 by @HuanzhiMao in [BFCL] Patch #724 #730
[BFCL] Multi Turn Dataset Fix (Miss Func & Long Context) by @HuanzhiMao in [BFCL] Multi Turn Dataset Fix (Miss Func & Long Context) #728
[BFCL] Multi Turn Dataset Fix (Miss Param) by @HuanzhiMao in [BFCL] Multi Turn Dataset Fix (Miss Param) #732
[BFCL] Update Eval Metric for Multi Turn Irrelevance Scenarios by @HuanzhiMao in [BFCL] Update Eval Metric for Multi Turn Irrelevance Scenarios #725
[BFCL] Remove duplicate in eval_runner.py by @ThomasRochefortB in [BFCL] Remove duplicate in eval_runner.py #735
[BFCL] Support Dynamic max_tokens for Locally-Hosted Models by @HuanzhiMao in [BFCL] Support Dynamic max_tokens for Locally-Hosted Models #712
[BFCL] Refine Evaluation Metric for Multi Turn Categories by @HuanzhiMao in [BFCL] Refine Evaluation Metric for Multi Turn Categories #733
[BFCL] Adding New Model GoGoAgent by @RogueTensor in [BFCL] Adding New Model GoGoAgent #720
[BFCL] Chore: Improve Inference Log Readability by @HuanzhiMao in [BFCL] Chore: Improve Inference Log Readability #746
[BFCL Dataset Revamp 1/n] Multi-Turn (Part 1) by @Fanjia-Yan in [BFCL Dataset Revamp 1/n] Multi-Turn (Part 1) #740
[BFCL] Robustness Patch for _multi_threaded_inference by @HuanzhiMao in [BFCL] Robustness Patch for _multi_threaded_inference #754
[BFCL] Prompt Caching for Claude Models by @VishnuSuresh27 in [BFCL] Prompt Caching for Claude Models #751
[BFCL Dataset Revamp 2/n] Live Dataset Fix (Simple, Parallel, Parallel Multiple) by @Fanjia-Yan in [BFCL Dataset Revamp 2/n] Live Dataset Fix (Simple, Parallel, Parallel Multiple) #737
[BFCL Dataset Revamp 3/n] Live Dataset Fix (Multiple) by @Fanjia-Yan in [BFCL Dataset Revamp 3/n] Live Dataset Fix (Multiple) #739
Update google-cloud-aiplatform version to 1.72.0 by @gabrielibagon in Update google-cloud-aiplatform version to 1.72.0 #760
[BFCL] Minor Grammatical Corrections to DEFAULT_SYSTEM_PROMPT by @HuanzhiMao in [BFCL] Minor Grammatical Corrections to DEFAULT_SYSTEM_PROMPT #747
[BFCL] Remove Llama-3.2-3B-Instruct-FC and Llama-3.2-1B-Instruct-FC from Leaderboard by @HuanzhiMao in [BFCL] Remove Llama-3.2-3B-Instruct-FC and Llama-3.2-1B-Instruct-FC from Leaderboard #749
[BFCL Chore] Supply data_multi_turn.csv for Multi-Turn Evaluation Results by @HuanzhiMao in [BFCL Chore] Supply data_multi_turn.csv for Multi-Turn Evaluation Results #762
[BFCL] Remove Workaround Patch for Vertex AI Package by @HuanzhiMao in [BFCL] Remove Workaround Patch for Vertex AI Package #761
Add exponential retry logic for gemini models by @gabrielibagon in Add exponential retry logic for gemini models #764
[BFCL] Remove Duplicate Line in record_cost_latency by @HuanzhiMao in [BFCL] Remove Duplicate Line in record_cost_latency #767
Fix handling of examples with no tools in Gemini by @gabrielibagon in Fix handling of examples with no tools in Gemini #770
Remove stop condition in gemini retry logic by @gabrielibagon in Remove stop condition in gemini retry logic #769
Skip adding empty content from gemini by @gabrielibagon in Skip adding empty content from gemini #768
[BFCL] Add the option to log to WandB during bfcl evaluate by @ThomasRochefortB in [BFCL] Add the option to log to WandB during bfcl evaluate #736
[BFCL] Add claude-3-5-haiku-20241022, claude-3-5-haiku-20241022-FC, claude-3-5-sonnet-20241022, claude-3-5-sonnet-20241022-FC by @HuanzhiMao in [BFCL] Add claude-3-5-haiku-20241022, claude-3-5-haiku-20241022-FC, claude-3-5-sonnet-20241022, claude-3-5-sonnet-20241022-FC #750
[BFCL Dataset Revamp 4/n] Live Irrelevance by @Fanjia-Yan in [BFCL Dataset Revamp 4/n] Live Irrelevance #763
[BFCL Dataset Revamp 5/n] Multi-Turn Base WrapUp by @Fanjia-Yan in [BFCL Dataset Revamp 5/n] Multi-Turn Base WrapUp #772
[BFCL] Add Unit Test to Check for Illegal Python Parameter Name by @HuanzhiMao in [BFCL] Add Unit Test to Check for Illegal Python Parameter Name #777
[BFCL] Dataset and Possible Answer Fix (Live Categories) for Illegal Python Parameter Name by @HuanzhiMao in [BFCL] Dataset and Possible Answer Fix (Live Categories) for Illegal Python Parameter Name #778
[BFCL] Add Support for Regeneration, Specific Test Entry IDs, and Custom Directory Locations by @Raymond112514 in [BFCL] Add Support for Regeneration, Specific Test Entry IDs, and Custom Directory Locations #743
[BFCL] some tiny fix in possible_answer by @zhangch-ss in [BFCL] some tiny fix in possible_answer #786
[RAFT] Add link to Azure RAFT Distillation Recipe by @cedricvidal in [RAFT] Add link to Azure RAFT Distillation Recipe #758
[BFCL] Add New Model Qwen/Qwen2.5-72B-Instruct by @HuanzhiMao in [BFCL] Add New Model Qwen/Qwen2.5-72B-Instruct #787
[BFCL] Add DeepSeek-V2.5, DeepSeek-Coder-V2-Instruct-0724, DeepSeek-Coder-V2-Lite-Instruct, DeepSeek-V2-Chat-0628, DeepSeek-V2-Lite-Chat by @moonlight1431 in [BFCL] Add DeepSeek-V2.5, DeepSeek-Coder-V2-Instruct-0724, DeepSeek-Coder-V2-Lite-Instruct, DeepSeek-V2-Chat-0628, DeepSeek-V2-Lite-Chat #697
Add minicpm3 4b FC model handler by @Cppowboy in Add minicpm3 4b FC model handler #718
[BFCL] Add support for Writer models and Palmyra X 004 by @samjulien in [BFCL] Add support for Writer models and Palmyra X 004 #755
[BFCL Chore] Add @final and @overrides Decorators to Class Methods in Model Handler by @VishnuSuresh27 in [BFCL Chore] Add @final and @overrides Decorators to Class Methods in Model Handler #790
[BFCL Chore] Support Multiple Models and Test Category Input for BFCL CLI by @vsvaidya27 in [BFCL Chore] Support Multiple Models and Test Category Input for BFCL CLI #795
[BFCL] Fix Irrelevance Category Performance for DeepSeek Coder Handler by @HuanzhiMao in [BFCL] Fix Irrelevance Category Performance for DeepSeek Coder Handler #796
[BFCL Chore] Quick fix change of decorators from @overrides to @override by @VishnuSuresh27 in [BFCL Chore] Quick fix change of decorators from @overrides to @override #797
[BFCL Chore] Add Retry Mechanism with Backoff for Rate Limit Handling Across Proprietary Models by @HuanzhiMao in [BFCL Chore] Add Retry Mechanism with Backoff for Rate Limit Handling Across Proprietary Models #781
[BFCL] Bug Fix for Execution_Result_Message Construction for Prompt Caching Feature in Claude Handler by @HuanzhiMao in [BFCL] Bug Fix for Execution_Result_Message Construction for Prompt Caching Feature in Claude Handler #805
[BFCL Dataset Revamp 7/n] Augmented Multi-turn Dataset Fix by @Fanjia-Yan in [BFCL Dataset Revamp 7/n] Augmented Multi-turn Dataset Fix #804
[BFCL Dataset Revamp 6/n] Live Relevance Data Fix by @Fanjia-Yan in [BFCL Dataset Revamp 6/n] Live Relevance Data Fix #789
Add Weaviate APIs to Gorilla API Zoo by @CShorten in Add Weaviate APIs to Gorilla API Zoo #783
[BFCL] Improve Latency Measurement Accuracy and Enable Default State Logging by @HuanzhiMao in [BFCL] Improve Latency Measurement Accuracy and Enable Default State Logging #808
[BFCL] Replace 'class' with '_class' to Avoid Function Calling Formatting Error by @Fanjia-Yan in [BFCL] Replace 'class' with '_class' to Avoid Function Calling Formatting Error #811
[BFCL] Added Grok Handler by @amitojsingh2022 in [BFCL] Added Grok Handler #810
[BFCL] Resolve Issue in Gemini Model When No Model Output by @HuanzhiMao in [BFCL] Resolve Issue in Gemini Model When No Model Output #809
[BFCL] Add Amazon Models nova-pro-v1.0, nova-lite-v1.0, and nova-micro-v1.0 by @HuanzhiMao in [BFCL] Add Amazon Models nova-pro-v1.0, nova-lite-v1.0, and nova-micro-v1.0 #815
[BFCL Chore] Revamp README.md for Clearer Instructions by @HuanzhiMao in [BFCL Chore] Revamp README.md for Clearer Instructions #819
[BFCL] Update gpt-4o Snapshot Version from 2024-08-06 to 2024-11-20 by @HuanzhiMao in [BFCL] Update gpt-4o Snapshot Version from 2024-08-06 to 2024-11-20 #822
fix some enum type errors in datasets by @zhangch-ss in fix some enum type errors in datasets #826
Fix Merge Conflict From fix some enum type errors in datasets #826 by @HuanzhiMao in Fix Merge Conflict From #826 #829
[BFCL Chore] Add Unit Test for Valid Func Doc Format by @HuanzhiMao in [BFCL Chore] Add Unit Test for Valid Func Doc Format #828
update hammer handler and add Hammer2.1 model by @linqq9 in update hammer handler and add Hammer2.1 model #832
[BFCL] Add New Model Llama-3.3-70B-Instruct, Llama-3.3-70B-Instruct-FC by @HuanzhiMao in [BFCL] Add New Model Llama-3.3-70B-Instruct, Llama-3.3-70B-Instruct-FC #837
[BFCL] Add o1-2024-12-17 and o1-2024-12-17-FC by @HuanzhiMao in [BFCL] Add o1-2024-12-17 and o1-2024-12-17-FC #840
Add Cohere Command R7B, replace older Command R+ handler by @harry-cohere in Add Cohere Command R7B, replace older Command R+ handler #835
[BFCL Dataset] Ground Truth Error Fix by @Fanjia-Yan in [BFCL Dataset] Ground Truth Error Fix #846
[BFCL] Add Qwen2.5-0.5B-Instruct, Qwen2.5-3B-Instruct, Qwen2.5-14B-Instruct, Qwen2.5-32B-Instruct by @HuanzhiMao in [BFCL] Add Qwen2.5-0.5B-Instruct, Qwen2.5-3B-Instruct, Qwen2.5-14B-Instruct, Qwen2.5-32B-Instruct #842
[BFCL] Add New Model watt-tool-8B and watt-tool-70B by @zhanghanduo in [BFCL] Add New Model watt-tool-8B and watt-tool-70B #847
[BFCL] Skip Executable Categories When API Keys Missing by @HuanzhiMao in [BFCL] Skip Executable Categories When API Keys Missing #848
[BFCL] Add gemini-2.0-flash-exp-FC, gemini-2.0-flash-exp, gemini-exp-1206-FC, gemini-exp-1206 by @HuanzhiMao in [BFCL] Add gemini-2.0-flash-exp-FC, gemini-2.0-flash-exp, gemini-exp-1206-FC, gemini-exp-1206 #843
Check and fix some parameter type errors in possible answers by @zhangch-ss in Check and fix some parameter type errors in possible answers #838
[BFCL] Use N/A in Score Report for Unevaluated Categories by @HuanzhiMao in [BFCL] Use N/A in Score Report for Unevaluated Categories #849
[BFCL] possible answer fix: - reigion ->region by @sghyan16 in [BFCL] possible answer fix: - reigion ->region #852
[BFCL] Add Mistral Local Serving Handler and Add New Model mistralai/Ministral-8B-Instruct-2410 by @HuanzhiMao in [BFCL] Add Mistral Local Serving Handler and Add New Model mistralai/Ministral-8B-Instruct-2410 #855
[BFCL] Add New Model DeepSeek-V3 by @HuanzhiMao in [BFCL] Add New Model DeepSeek-V3 #857
[BFCL] Rename Directories: proprietary_model->api_inference, oss_model->local_inference for Better Clarity by @HuanzhiMao in [BFCL] Rename Directories: proprietary_model->api_inference, oss_model->local_inference for Better Clarity #859
[BFCL] Support for pre-existing completion endpoint by @ThomasRochefortB in [BFCL] Support for pre-existing completion endpoint #864
[BFCL Chore] Ensure Correct Input Format for Eval Checker by @HuanzhiMao in [BFCL Chore] Ensure Correct Input Format for Eval Checker #860

New Contributors

@devanshamin made their first contribution in [BFCL] Package the Codebase #565
@himanshushukla12 made their first contribution in Added python script named as raft_local.py to raft directory to run script completely locally using HF models #605
@kobe0938 made their first contribution in Fix issue #614: [BFCL] ModuleNotFoundError after commit 70d6722 #615
@aw632 made their first contribution in Fix some bugs in test case prompts/ground truths #608
@linqq9 made their first contribution in [BFCL] add MadeAgents/Hammer-7b handler #627
@zhangch-ss made their first contribution in fix: bug for glm prompt format #638
@VishnuSuresh27 made their first contribution in [BFCL] Bug Fix parse_nested_value function for model_handler utils #660
@AndyChenYH made their first contribution in added Phi-3 handlers #640
@XuHwang made their first contribution in [BFCL] Add ToolACE handler for BFCL-v3 #653
@leosun12 made their first contribution in update README.md #669
@jieru-hu made their first contribution in Update google-cloud-aiplatform dependency #677
@Cppowboy made their first contribution in add minicpm3 4b #633
@jacovkim made their first contribution in [BFCL] Add Gemma-2 models #696
@mattf made their first contribution in add a basic bfcl command-line interface #621
@virginie-do made their first contribution in Fixing BFCL-v3 multi-turn apps #701
@hnyls2002 made their first contribution in [BFCL] Add SGLang Backend Support for OSS Local Inference #587
@PrathameshSPawar made their first contribution in (typo):I've made some corrections to your repository to improve clarity #713
@bhargavshirin made their first contribution in docs: Centered the Image #680
@daanaea made their first contribution in [BFCL] Small typo in variable name in travel_booking.py #731
@ThomasRochefortB made their first contribution in [BFCL] Remove duplicate in eval_runner.py #735
@RogueTensor made their first contribution in [BFCL] Adding New Model GoGoAgent #720
@gabrielibagon made their first contribution in Update google-cloud-aiplatform version to 1.72.0 #760
@moonlight1431 made their first contribution in [BFCL] Add DeepSeek-V2.5, DeepSeek-Coder-V2-Instruct-0724, DeepSeek-Coder-V2-Lite-Instruct, DeepSeek-V2-Chat-0628, DeepSeek-V2-Lite-Chat #697
@samjulien made their first contribution in [BFCL] Add support for Writer models and Palmyra X 004 #755
@vsvaidya27 made their first contribution in [BFCL Chore] Support Multiple Models and Test Category Input for BFCL CLI #795
@CShorten made their first contribution in Add Weaviate APIs to Gorilla API Zoo #783
@amitojsingh2022 made their first contribution in [BFCL] Added Grok Handler #810
@zhanghanduo made their first contribution in [BFCL] Add New Model watt-tool-8B and watt-tool-70B #847
@sghyan16 made their first contribution in [BFCL] possible answer fix: - reigion ->region #852

Full Changelog: v1.1...v1.2

This discussion was created from the release Berkeley Function Calling Leaderboard Updates (v1.2).

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment