unorm icon indicating copy to clipboard operation
unorm copied to clipboard

Published 20 hours ago • verified publisher icon walling

Look at library size

Open walling opened this issue 11 years ago • 6 comments

We could potentially compress the udata better. I've been researching this a bit, and we could shave a good amount of bytes by changing the data layout and save in base-36 (which is fast for JavaScript to decode with parseInt).

I also think it's an issue that the code points are layout in this binary format: yyyyyxxxxxxxxyyyyyyyy. This makes the x=0 section quite big, but many times you'd only use latin1 characters and not characters outside the BMP. A better format would be xxxxxxxxxxxxxyyyyyyyy. This creates more data rows, but you have to decompress less data in average, based on the assumption that normal text only revolves around a few Unicode scripts. Or maybe we should make a split between the way BMP and outside-BMP is stored.

I just need to look at my research files again and write the points of my research down in this issue.

walling avatar Nov 18 '13 10:11 walling

I really doens't full understand how unorm works, I just did some general code improvements :)

Befofe trying to optimize also for size, we should make the benchmark suite. Than one could be separate first priority issue. Maybe there are already some good input files available somewhere already.

phadej avatar Nov 21 '13 13:11 phadej

True, a benchmark suite would be a nice first step.

walling avatar Jan 07 '14 13:01 walling

Still looking to do this? Just noticed unorm accounts for 15% of my applications build size haha.

dcousens avatar Oct 16 '15 22:10 dcousens

5 years later.. anyone still interested in take some look at this issue? :)

having some trouble with the package size..

claudiolcastro avatar Jul 23 '18 15:07 claudiolcastro

@claudiolcastro Unfortunately I haven't got the time to look at this project a lot. If anyone is ready to step up and review/merge PRs, I'm ready to hand out commit access and/or publishing rights on npm. There are many small things that could be done to improve the library.

walling avatar Jul 25 '18 18:07 walling

I was also concerned about the size of this package and since it is only a polyfill for my project, I didn't want all users to have to download it.

The cleanest and easiest solution I found was using Polyfill.io to include it when necessary:

<script crossorigin="anonymous" src="https://polyfill.io/v3/polyfill.min.js?flags=gated&features=String.prototype.normalize"></script>

You can use their URL builder here: https://polyfill.io/v3/url-builder/

hybridvision avatar Sep 17 '19 07:09 hybridvision