ignitenlp

Archived This repository is archived: read-only and no longer maintained.

Overview

In this example, we show how to use Ignite to finetune a transformer model:

Alternatively, install the all requirements using pip install -r requirements.txt.

Run the example on a single GPU:

If needed, please, adjust the batch size to your GPU device with --batch_size argument.

The default model is bert-base-uncased incase you need to change that use the --model argument, for details on which models can be used refer here

For details on accepted arguments:

Let's start training on a single node with 2 gpus:

Please, make sure to have Horovod installed before running.

Let's start training on a single node with 2 gpus:

For more details, see https://allegro.ai/clearml/docs/docs/examples/reporting/artifacts.html

From the project’s README on GitHub.

Repository	Kentucky-Open-Science/ignitenlp
Research area	Language models & AI tooling
Primary language	Python
License	None specified
Stars / forks	0 / 0
Open issues and pull requests	0
Created	2022-04-04
Last push	2022-04-05
Default branch	`master`
Topics	nlp

native_research_llms Ruby · ★ 3 · updated 2026-09-22
Registry of LLMs pretrained from scratch by universities, non-profit research institutes, and national laboratories
llm-ddx Python · ★ 0 · updated 2026-04-15
No description on GitHub yet.
llm_factory_demos Python · ★ 0 · updated 2026-02-05
No description on GitHub yet.
llm-basics Python · ★ 0 · updated 2025-05-27
This repository contains simple examples showing how to use the OpenAI API to communicate with LLM Factory Endpoints for various AI tasks.
llmfactory ★ 0 · updated 2024-01-31
No description on GitHub yet.

git clone https://github.com/Kentucky-Open-Science/ignitenlp.git