Handwriting recognition support
“allows me to take notes with my pen on my iPad and later convert them to text notes for reference on Mac“
“The workflow is basically the same as described above-
Take notes using pen on iPad (while in a meeting)
Use AI (or ocr enabled apps) to convert handwriting to text
sometimes I will just use plain keyboard on Mac to edit those notes in real time or start the notes on Mac with a date time stamp and continue on iPad using”
Log in to comment and vote
Comments6
Motion Tempo
Oct 1
This would be great for web version too. Since you have the raw point cloud, you don’t even need to render image.
Dorweiler & Reimertz GbR
Oct 2
Can you please explain this further?
Motion Tempo
Oct 3
From what I’ve seen, each stroke is stored as a collection of points (for example, “-226.6040625,
-58.37,
-227.2540625,
-55.24”). Because of this, instead of rendering the strokes, which could be expensive, and then OCR’ing, you could use the data itself to perform the OCR. This is called online OCR (don’t let the name fool you, no internet needed). GBoard and Apple Scribe (if I’m not mistaken) use this kind of approach, since it’s quite error-free. “https://arxiv.org/abs/1902.10525” has a clearer explanation.
Dorweiler & Reimertz GbR
Oct 3
Ahh, thank you. And your desired behavior would be that the handwriting will be transformed to written text directly. We are not very familiar with handwritten note-taking and are eager to learn more about it. Just to clarify, we are talking about the document item type, correct? The desired behavior would be to handwrite in the document, and it will automatically be transformed to normal text on native devices and in the browser. You are not talking about the handwriting recognition on the canvas that was shipped with the latest update to make the notes searchable.
Motion Tempo
Oct 4
I was thinking something like having a concrete option that, with some stroke(s) selected would appear, would create a note with the OCR. The handwriting in the document isn’t a bad idea, but markdown export could be funky then. Also, what do you mean by “You are not talking about the handwriting recognition on the canvas that was shipped with the latest update to make the notes searchable.”? Sure, text within them is searchable, but you can’t handwrite in them?
Dorweiler & Reimertz GbR
Oct 4
Ahh! Now I get it 💡 Thank you for the video 👏🏼