PyPI page
Home page
Author:
None
License:
Apache License 2.0
Summary:
Framework for evaluation of foundation models
Latest version:
0.5.11
Required dependencies:
bottle
|
cattrs
|
colorlog
|
dacite
|
datasets
|
flax
|
jax
|
jaxlib
|
mako
|
nltk
|
numpy
|
opencv-python
|
opencv-python-headless
|
pandas
|
pyarrow
|
pyarrow-hotfix
|
pyhocon
|
retrying
|
rouge-score
|
scikit-learn
|
scipy
|
spacy
|
sqlitedict
|
torch
|
torchvision
|
tqdm
|
transformers
|
uncertainty-calibration
|
zstandard
Optional dependencies:
accelerate
|
ai2-olmo
|
aleph-alpha-client
|
anthropic
|
apscheduler
|
autokeras
|
av
|
awscli
|
bert_score
|
boto3
|
botocore
|
clang
|
clip-anytorch
|
cohere
|
colorcet
|
crfm-helm
|
cryptography
|
diffusers
|
dspy
|
einops
|
einops-exts
|
email-validator
|
evaluate
|
fairlearn
|
fastapi
|
fastapi_sso
|
ffmpeg-python
|
flash-attn
|
ftfy
|
gdown
|
google-api-python-client
|
google-cloud-aiplatform
|
google-cloud-storage
|
google-cloud-translate
|
google-genai
|
gradio_client
|
gunicorn
|
html2text
|
ibm-watsonx-ai
|
icetk
|
imagehash
|
immutabledict
|
jieba
|
jiwer
|
langdetect
|
latex
|
levenshtein
|
librosa
|
lpips
|
lxml
|
matplotlib
|
mistralai
|
multilingual-clip
|
nudenet
|
numba
|
numpy
|
omegaconf
|
open-clip-torch
|
openai
|
openai-whisper
|
opencc
|
opencv-python-headless
|
openpyxl
|
pdf2image
|
pillow
|
pycocoevalcap
|
pydantic
|
pydub
|
pymongo
|
pyonmttok
|
pypinyin
|
pythainlp
|
python-crfsuite
|
python-docx
|
python-multipart
|
pytorch-fid
|
pytorch-lightning
|
pytrec_eval
|
qwen-vl-utils
|
rapidfuzz
|
reka-api
|
sacrebleu
|
scaleapi
|
scikit-image
|
scipy
|
seaborn
|
selenium
|
sentence_transformers
|
sentencepiece
|
simple-slurm
|
soundfile
|
surge-api
|
tensorflow
|
tiktoken
|
timm
|
together
|
tokenizers
|
torch
|
torch-fidelity
|
torchmetrics
|
torchvision
|
transformers
|
transformers_stream_generator
|
unidecode
|
wandb
|
websocket-client
|
writerai
|
xlrd
Downloads last day:
33
Downloads last week:
183
Downloads last month:
1,607