Sign Up for Free

RunKit +

Try any Node.js package right in your browser

This is a playground to test code. It runs a full Node.js environment and already has all of npm’s 1,000,000+ packages pre-installed, including tokenizer2 with all npm packages installed. Try it out:

var tokenizer2 = require("tokenizer2")

This service is provided by RunKit and is not affiliated with npm, Inc or the package authors.

tokenizer2 v2.0.1

tokenize any text stream given some basic regex rules to match tokens

RunKit is a free, in-browser JavaScript dev environment for prototyping Node.js code, with every npm package installed. Sign up to share your code.
Sign Up for Free