You are reading a single comment by @fanoush and its replies. Click here to read the full conversation.
  • Also when thinking about it there is another part on server for pretokenizing files before upload so that would need another method for testing.

    But anyway, tokenizing is quite deterministic so it should either work or the tokenized source is wrong so it should fail in deterministic way, random bugs are likely caused by something else.

About

Avatar for fanoush @fanoush started