Nlp what is a token

doc = nlp("We are putting in the efforts to enhance our understanding of Lemmatization") " ".join([token.lemma_ for token in doc]) In the above code snippet, we are passing the same sentence used previously to the spaCy model. The model processes the text and saves it as tokens in the variable "doc". . .