applied_nlp_demos下载applied_nlp

applied_nlp_demos

Ai源码

1.0.0

下载

pytorch中的applied_nlp_demos

现代NLP

预处理T5 V1.1：C4数据集代码上的预训练T5。与HuggingFace相比，此代码非常复杂，更可读性，更真实，并且对Google的实现更加真实。与T5 1.1论文相比，在65,536步中报告1.942损失，单个RTX 4090在使用此代码的大约18.5小时的培训中在测试集（2.08）上产生可比的结果（请参见下图）。在您自己的数据集上进行预处理就像用自己的数据集交换现有Dataset一样简单。

T5预处理损失

seq2seq（聊天机器人）：羊驼代码上的微调flan-t5
SEQ2SEQ：使用HuggingFace数据集框架代码在数据上进行微调Flan-T5

Google/flan-t5大

 input sentence: Given a set of numbers, find the maximum value.
{10, 3, 25, 6, 16}
response: 25

input sentence: Convert from celsius to fahrenheit.
Temperature in Celsius: 15
response: Fahrenheit

input sentence: Arrange the given numbers in ascending order.
2, 4, 0, 8, 3
response: 0, 3, 4, 8

input sentence: What is the capital of France?
response: paris

input sentence: Name two types of desert biomes.
response: sahara

Google/flan-t5-large：在羊驼上进行微调

 input sentence: Given a set of numbers, find the maximum value.
{10, 3, 25, 6, 16}
response: 25

input sentence: Convert from celsius to fahrenheit.
Temperature in Celsius: 15
response: 77

input sentence: Arrange the given numbers in ascending order.
2, 4, 0, 8, 3
response: 0, 2, 3, 4, 8

input sentence: What is the capital of France?
response: Paris

input sentence: Name two types of desert biomes.
response: Desert biomes can be divided into two main types: arid and semi-arid. Arid deserts are characterized by high levels of deforestation, sparse vegetation, and limited water availability. Semi-desert deserts, on the other hand, are relatively dry deserts with little to no vegetation.