Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sorting features triggers IndexOutOfBoundsException in vectorized path #185

Open
springmeyer opened this issue Jun 21, 2024 · 0 comments
Open

Sorting features triggers IndexOutOfBoundsException in vectorized path #185

springmeyer opened this issue Jun 21, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@springmeyer
Copy link
Collaborator

If feature are sorted and then the vectorized decoding path is used and all features are iterated over, an exception is triggered:

MltDecoderTest > Decode OMT Tiles (advanced encodings) > com.mlt.decoder.MltDecoderTest.decodeOMTTiles(String)[6] FAILED
    java.lang.IndexOutOfBoundsException
        at java.base/java.nio.Buffer.checkIndex(Buffer.java:743)
        at java.base/java.nio.HeapIntBuffer.get(HeapIntBuffer.java:169)
        at com.mlt.vector.dictionary.StringDictionaryVector.getValueFromBuffer(StringDictionaryVector.java:71)
        at com.mlt.vector.dictionary.StringDictionaryVector.getValueFromBuffer(StringDictionaryVector.java:12)
        at com.mlt.vector.Vector.getValue(Vector.java:29)
        at com.mlt.vector.FeatureTable$1.next(FeatureTable.java:52)
        at com.mlt.vector.FeatureTable$1.next(FeatureTable.java:31)
        at com.mlt.TestUtils.compareTilesVectorized(TestUtils.java:76)
        at com.mlt.decoder.MltDecoderTest.testTile(MltDecoderTest.java:204)
        at com.mlt.decoder.MltDecoderTest.decodeOMTTiles(MltDecoderTest.java:123)
springmeyer added a commit to springmeyer/maplibre-tile-spec that referenced this issue Jun 21, 2024
@springmeyer
Reference maplibre#185
82afe27
@springmeyer springmeyer added the bug Something isn't working label Jun 21, 2024
@springmeyer springmeyer mentioned this issue Jun 21, 2024
Merged
2 tasks
springmeyer added a commit that referenced this issue Jun 25, 2024
@springmeyer
Test additional code paths in java decoder (#180)
b3edfa4 
Currently we do not fully test all these combinations:

 - Vectorized path + advanced encodings
 - Vectorized path + without advanced encodings
 - Non-Vectorized path + advanced encodings
 - Non-Vectorized path + without advanced encodings
 
This PR starts testing all those paths.

The code coverage changes are:

 - **overall:** `36%`to `45%`
 - **mlt.converter:** `64%` to `85%`
 - **mlt.decoder:** `55%` to `71%`

In addition this PR includes:

- Some refactoring in TestUtils.java to share more code between
vectorized and non-vectorized
- Improvements to TestUtils.java around geometry comparisons (refs #178)
 - Improvements to TestUtils.java around property comparisons

Finally, this PR does not attempt to solve any bugs. Rather it finds,
isolates, and writes tests harnesses to capture them in code. Once bugs
are solved in the future it should be easy to update the tests
accordingly.

TODO:
- [x] ~This PR uncovered a number of bugs that do not have open issues
and did not have tests that hit them until now. So I need to create
following issues to capture fixing these.~
     - Added:
        - #181
        - #182 
        - #183 
        - #184
        - #185
        - #186
- [ ] Property nesting in MLT makes comparison to MVT difficult so I
disabled it in this test refactor because comparison to MVT is what the
decoder tests rely on. My sense is that standalone unit tests of nesting
might be more appropriate than including nesting in the decoder tests.
Do others agree?
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@springmeyer