* initial create vocabulary utility

* extract vocabulary from embeddings

* renamed to --output-word-count-file

* added main call

* extracted iter_tokenized_tokens

* avoid empty tokens

* using tokenizer from delft

* optionally sort by count

* added file list support

* added support for remote files

* added limit argument

* added fsspec dependency

* optionally use multi threading or processing

* included full github link

* renamed to create_vocabulary

* moved to tools vocabulary

* filter embeddings

* renamed to embeddings

* using fsspec to open embeddings file when extracting

* use fsspec when filtering embeddings

* document tools

* added link to tools.md

* added dev-venv target

* added subextract model

* added nltk dependency

* flake8 ignore line break before binary operator

* moved dev dependencies up

* added nltk punkt download

* added nltk download to dev-venv; pytest and pytest-not-slow target

* added subextract training pipeline

* added optional xpath namespaces

* log failed xml file

* use recover parser option

* added subextract app

* start subextract server

* renamed to autocut

* declare slow and very_slow pytest markers

* make autocut main test as slow

* fixed post data

* updated README

* also build non-dev image as part of ci

* added pytest.ini to dev image

* added sciencebeam-utils and sciencebeam-alignment dependency

* replaced local alignment module with sciencebeam-alignment

* replaced local beam_utils with sciencebeam-utils

* replaced local utils with sciencebeam-utils for modules that have moved

* removed tools that have been moved to sciencebeam-utils

* removed utility functions that have moved to sciencebeam-utils

* updated readme

* moved crf and cv conversion pipelines to sciencebeam-gym

* copied documentation from sciencebeam

* Renamed files to be consistent with 'sciencebeam' repo

* Update Dockerfile and README after filename change

* Update version of tensorflow-transform to 0.6

* Pin versions of oauth2client and httplib2 to prevent errors with google-cloud. Update apache_beam to 2.4 as used by new version of tensorflow-transform

* upgrade Apache Beam version

* do not inherit MockFileSystem from LocalFileSystem

* upgraded dependencies

* added pylint to dependencies

* addressed np.fromstring warning