Commit Graph

612 Commits

Author SHA1 Message Date
mpostma 41e271974a add tests 2021-07-06 16:21:15 +02:00
mpostma 520d37983c implement index search methods 2021-07-06 11:54:09 +02:00
mpostma 066085f6f5 fix index deletion bug 2021-07-05 18:42:13 +02:00
mpostma 2f3a439566 fix tests 2021-07-05 16:31:52 +02:00
mpostma 9681ffca52 change index create http code 2021-07-05 16:31:51 +02:00
bors[bot] fddc60f893
Merge #1471
1471: Bump milli to 0.7.2 r=irevoire a=irevoire



Co-authored-by: Tamo <tamo@meilisearch.com>
2021-07-05 13:29:38 +00:00
bors[bot] 0f024cc225
Merge #1478
1478: refactor routes r=irevoire a=MarinPostma

refactor the route directory, so the module tree follows the route structure


Co-authored-by: mpostma <postma.marin@protonmail.com>
2021-07-05 12:55:39 +00:00
mpostma 575ec2a06f refactor routes 2021-07-05 14:33:48 +02:00
mpostma bc85d30076
add test 2021-07-05 12:33:28 +02:00
mpostma bc417726fc
fix update loop bug 2021-07-05 12:33:22 +02:00
Tamo 9949a2a930
bump milli to 0.7.2 2021-07-05 12:19:27 +02:00
bors[bot] 71e1cb472f
Merge #1457
1457: Hotfix highlight on emojis panic r=Kerollmops a=ManyTheFish

When the highlight bound is in the middle of a character
or if we are out of bounds, we highlight the complete matching word.

note: we should enhance the tokenizer and the Highlighter to match char indices.

Fix #1368

Co-authored-by: many <maxime@meilisearch.com>
2021-07-01 14:48:18 +00:00
many 38161ede33
Add test with special characters 2021-07-01 16:44:17 +02:00
Kerollmops fa5f8f9531
Fix an issue with the update loop falsely breaking 2021-07-01 14:53:31 +02:00
many acfe31151e
Hotfix panic for unicode characters
When the highlight bound is in the middle of a character
or if we are out of bounds, we highlight the complete matching word.

note: we should enhance the tokenizer and the Highlighter to match char indices.

Fix #1368
2021-07-01 14:49:22 +02:00
bors[bot] 5c9401ad94
Merge #1438
1438: Update milli to 0.7.1 r=curquiza a=curquiza



Co-authored-by: Clémentine Urquizar <clementine@meilisearch.com>
2021-06-30 18:49:41 +00:00
bors[bot] 768987583a
Merge #1428
1428: Accept any content type as json r=curquiza a=irevoire



Co-authored-by: Tamo <tamo@meilisearch.com>
2021-06-30 18:29:57 +00:00
Clémentine Urquizar 4f0d3b065f
Update milli 2021-06-30 18:39:06 +02:00
Tamo a95c44193d
Do not block when sending update notifications 2021-06-30 17:29:22 +02:00
Tamo 2830853665
accept any content type as json 2021-06-30 17:05:59 +02:00
Clémentine Urquizar 01de7f9e36
Update version 2021-06-30 15:59:59 +02:00
bors[bot] eeca841a21
Merge #259
259: Run rustfmt one the whole project and add it to the CI r=curquiza a=irevoire

Since there is currently no other PR modifying the code, I think it's a good time to reformat everything and add rustfmt to the ci.

Co-authored-by: Tamo <tamo@meilisearch.com>
2021-06-30 11:55:30 +00:00
bors[bot] f1cc141f6c
Merge #258
258: Use rustls instead of openssl r=curquiza a=irevoire

I also removed all the `default-features` of reqwest since we are only using the JSON one.
Fix #255

Co-authored-by: Tamo <tamo@meilisearch.com>
2021-06-29 14:42:25 +00:00
Tamo 29bf6a8d42
run rustfmt one the whole project and add it to the CI 2021-06-29 15:25:18 +02:00
Tamo fe7640555d
fix the content-type 2021-06-29 13:16:56 +02:00
Tamo ec809ca487
use rustls instead of openssl and remove all default-features of reqwest 2021-06-29 13:07:40 +02:00
Tamo 1dc99ea451
accept no content-type as json 2021-06-29 11:59:25 +02:00
bors[bot] f12ace3fbf
Merge #256
256: Update heed and milli r=irevoire a=curquiza



Co-authored-by: Clémentine Urquizar <clementine@meilisearch.com>
2021-06-29 08:49:22 +00:00
Clémentine Urquizar c09e610bb5
Update heed and milli 2021-06-29 10:25:47 +02:00
bors[bot] 712abf4c5f
Merge #246
246: Stop logging the no space left on device error r=curquiza a=irevoire

closes #208
@qdequele what do you think of that?
Are there any other errors we need to ignore?

As you can see in the code, once we are in `Sentry` the error has already been converted to a `String` so the only thing we can do to see if we need to send the error or not is to match the `String` against our error message. 
If we have a lot of other logs we want to ignore I would suggest prefixing all the logs with something like:
```
User error: No space left on device
```
So in Sentry, we could just check if the log start by `User error:` and ignore all these errors at once

Co-authored-by: Tamo <tamo@meilisearch.com>
2021-06-29 08:20:49 +00:00
bors[bot] b0f399a51d
Merge #249
249: Use half of the computer threads for the indexing process by default r=Kerollmops a=irevoire

closes #241 
By default, we use only half of the CPU threads when indexing documents; this allows the user to use the search while indexing. Also, the machine will not appear unresponsive when indexing a large batch of documents.

On the special case where a user only has one core, we use it entirely 😄 

Co-authored-by: Tamo <tamo@meilisearch.com>
2021-06-28 15:25:11 +00:00
Morgane Dubus a26bb50d62
Update mini-dashboard to v.0.1.3 2021-06-28 15:13:52 +02:00
Tamo a59f437ee3
use only half of the computer threads for the indexation by default 2021-06-28 14:35:50 +02:00
Tamo d74c698adc
stop logging the no space left on device error 2021-06-28 13:59:48 +02:00
Tamo c1c50f6714
unused borrow that must be used 2021-06-28 13:35:25 +02:00
marin postma 01b09c065b
change route to service<resource> 2021-06-24 19:02:28 +02:00
marin postma 3b601f615a
declare new authentication related errors 2021-06-24 16:53:20 +02:00
marin postma fbd58f2eec
clippy 2021-06-24 16:36:22 +02:00
marin postma 79fc3bb84e
fmt 2021-06-24 16:36:22 +02:00
marin postma 8e4928c7ea
fix tests 2021-06-24 16:36:22 +02:00
marin postma d078cbf39b
remove authentication middleware 2021-06-24 16:36:21 +02:00
marin postma 561596d8bc
update stats routes 2021-06-24 16:36:18 +02:00
marin postma 549b489c8a
update settings routes 2021-06-24 16:35:48 +02:00
marin postma 1e9f374ff8
update running route 2021-06-24 16:35:12 +02:00
marin postma 817fcfdd88
update keys route 2021-06-24 16:35:12 +02:00
marin postma fab50256bc
update index routes 2021-06-24 16:35:04 +02:00
marin postma b044608b25
update health route 2021-06-24 16:32:45 +02:00
marin postma ce4fb8ce20
update dump route 2021-06-24 16:32:43 +02:00
marin postma adf91d286b
update documents and search routes 2021-06-24 16:32:15 +02:00
marin postma 0c1c7a3dd9
implement authentication policies 2021-06-24 16:31:30 +02:00
marin postma 5b71751391
policies macros 2021-06-24 16:31:30 +02:00
marin postma 12f6709e1c
move authencation to extractor mod 2021-06-24 16:31:28 +02:00
marin postma 5229f1e220
experimental auth extractor 2021-06-24 16:30:15 +02:00
bors[bot] b6ca7929eb
Merge #240
240: Rework error messages r=irevoire a=MarinPostma

Simplify the error messages, and make them more compliant with legacy Meilisearch.

Basically, stop composing the messages, and simply forward the message of inner errors.


Co-authored-by: marin postma <postma.marin@protonmail.com>
2021-06-24 11:36:11 +00:00
Tamo ad8d9a97d6
debug the body of every http request 2021-06-24 11:22:11 +02:00
Tamo 36f32f58d4
add the log_level variable to the cli and reduce the log level of milli and grenad 2021-06-24 11:20:52 +02:00
Tamo b4fd4212ad
reduce the log level of some info! 2021-06-24 11:20:52 +02:00
marin postma a1d34faaad
decompose error messages 2021-06-24 10:57:28 +02:00
bors[bot] a2368db154
Merge #239
239: Bump milli to 0.6.0 r=MarinPostma a=MarinPostma

fix #231


Co-authored-by: marin postma <postma.marin@protonmail.com>
2021-06-24 08:08:41 +00:00
marin postma 74bb748a4e
bump milli to 0.6.0 2021-06-23 18:40:19 +02:00
bors[bot] 8638c9ab77
Merge #232
232: Fix payload size limit r=MarinPostma a=MarinPostma

Fix #223

This was due to the fact that Payload ignores the limit payload size limit. I fixed it by implementing my own `Payload` extractor that checks that the size of the payload is not too large.

I also refactored the `create_app` a bit.

Co-authored-by: marin postma <postma.marin@protonmail.com>
2021-06-23 16:06:08 +00:00
bors[bot] b676b10cfe
Merge #238
238: Fix settings subroutes get r=MarinPostma a=MarinPostma

Fix #225 

Co-authored-by: marin postma <postma.marin@protonmail.com>
2021-06-23 15:45:50 +00:00
marin postma f68c257452
move flush in write_to_file function 2021-06-23 16:49:25 +02:00
marin postma 880fc069bd
remove dbg 2021-06-23 16:49:25 +02:00
marin postma a838238a63
move payload to own module 2021-06-23 16:49:25 +02:00
marin postma 834995b130
clippy + fmt 2021-06-23 16:49:23 +02:00
marin postma b000ae7614
remove file if write to update file fails 2021-06-23 16:48:33 +02:00
marin postma f62779671b
change error message for payload size limit 2021-06-23 16:48:33 +02:00
marin postma 4b292c6e9b
add payload limit to app config 2021-06-23 16:48:33 +02:00
marin postma 1c13100948
implement custom payload 2021-06-23 16:48:31 +02:00
marin postma 71226feb74
refactor create_app macro 2021-06-23 16:47:15 +02:00
marin postma b9b4feada8
add tests 2021-06-23 16:21:32 +02:00
bors[bot] 3175f09989
Merge #235
235: Fix dump not found error r=MarinPostma a=MarinPostma

fix #233


Co-authored-by: marin postma <postma.marin@protonmail.com>
2021-06-23 14:21:07 +00:00
marin postma 322d6b8cfe
fix serialization bug in settings 2021-06-23 15:25:56 +02:00
marin postma da36a6b5cd
fix not found error 2021-06-23 15:06:36 +02:00
bors[bot] f2b2ca6d55
Merge #227
227: improve mini dashboard routing r=MarinPostma a=MarinPostma

The dependency we use to statically serve the mini-dashboard used globing to serve the mini-dashboard files. This caused all unfound routes to be caught by the "/" serving the dashboard assets. This fix makes it so that the assets have a dedicated route, and any unfound route is caught by the default service and return a 404.


Co-authored-by: marin postma <postma.marin@protonmail.com>
2021-06-23 13:01:40 +00:00
Clémentine Urquizar ec3140a29e
Fix clippy 2021-06-23 11:23:57 +02:00
Clémentine Urquizar 00b0a00fc5
Add exhaustiveFacetsCount 2021-06-23 11:05:30 +02:00
bors[bot] adb970edcc
Merge #226
226: Make facetsDistribution name iso r=MarinPostma a=curquiza

Even if there is an English mistake in `facets_distribution` (because of the `s`) @gmourier asked me to keep the typo: the name of `facetsDistribution` might change completely in the future, he wants to avoid two breakings.

@gmourier can you confirm before we merge this PR?

Sorry I left this update in the code (I'm confused because no issues was open to update `facetsDistribution`), there might have been a confusion with `fieldsDistribution` that has been renamed into `fieldDistribution`. Sorry!

Co-authored-by: Clémentine Urquizar <clementine@meilisearch.com>
2021-06-23 08:14:12 +00:00
Clémentine Urquizar 6d24a4744f
Roll back facetsDistribution 2021-06-23 10:04:01 +02:00
marin postma b1a5ef0aab
improve mini dashboard routing 2021-06-22 21:49:05 +02:00
bors[bot] 7ec752ed1c
Merge #224
224: Update version for alpha 6 r=MarinPostma a=curquiza



Co-authored-by: Clémentine Urquizar <clementine@meilisearch.com>
2021-06-22 18:20:09 +00:00
Clémentine Urquizar 0de696feaf
Update version for alpha 6 2021-06-22 18:40:51 +02:00
marin postma 3456a78552
refactor formatter
share the analyzer instance between the formatter and the
compute_matches function
2021-06-22 18:28:20 +02:00
marin postma eb3d63691a
add tests 2021-06-22 18:12:53 +02:00
marin postma c4ee937635
optimize fromat string 2021-06-22 18:12:53 +02:00
marin postma f6d1fb7ac2
fmt 2021-06-22 18:12:53 +02:00
marin postma 97ef4a6c22
implement matches 2021-06-22 18:12:52 +02:00
bors[bot] db7215eaa9
Merge #213
213: Implement all the CLI options r=MarinPostma a=irevoire

closes #206 
And I looked into #204, I fixed some default values and tried to test as many options as possible, and I think the cli is already mostly working.
If someone knows any issues about it, I would like to hear more 🙂 

Co-authored-by: Tamo <tamo@meilisearch.com>
2021-06-22 15:04:05 +00:00
bors[bot] 4b37a4a415
Merge #211 #218
211: fix index deletion race condition r=MarinPostma a=MarinPostma

Make update store block if the currently processing update is from an index we are trying to delete. This ensure that no write to the index can occur after it has been deleted.

218: Update milli version to v0.5.0 r=MarinPostma a=curquiza



Co-authored-by: marin postma <postma.marin@protonmail.com>
Co-authored-by: Clémentine Urquizar <clementine@meilisearch.com>
2021-06-22 14:36:34 +00:00
marin postma caa231aebe
fix race condition 2021-06-22 16:09:07 +02:00
marin postma 9cc31c2258
fix get search crop len 2021-06-22 16:01:40 +02:00
Clémentine Urquizar e2844f3a92
Update tokenizer version to v0.2.3 2021-06-22 15:57:47 +02:00
Clémentine Urquizar 2e3d85c31a
Update milli version to v0.5.0 2021-06-22 15:57:46 +02:00
bors[bot] 25af262e79
Merge #210
210: Error handling r=MarinPostma a=MarinPostma

This pr implements the error handling for meilisearch.

Rather than grouping errors by types, this implementation groups them by scope, each scope enclosing errors from a scope further down, or new errors within this scope. This makes the tracking of the origins of errors easier , and error handling easier at the module level.

All errors that are eventually returned to the user implement the `Into<ResponseError>` trait. `ReponseError` in turn implements the `ErrorCode` trait from `meilisearch-error`.

Some new errors have been introduced with the new engine for which we haven't defined error codes yet. It has been decided with @gmourier that those would return the `internal-error` code until the correct error code is specified.


Co-authored-by: marin postma <postma.marin@protonmail.com>
2021-06-22 13:21:33 +00:00
marin postma d0ef1ef174
change errors codes 2021-06-22 11:58:01 +02:00
marin postma 905ace3e13
fix test 2021-06-22 11:10:57 +02:00
marin postma 9092d35a3c
fix payload error handler 2021-06-21 21:51:38 +02:00
marin postma 2bdaa70f31
invalid update payload returns bad_request 2021-06-21 18:56:22 +02:00
marin postma f91a3bc6ab
set error content type to json 2021-06-21 18:48:05 +02:00
marin postma 1e4592dd7e
enable errors in updates 2021-06-21 18:42:47 +02:00
Tamo 76727455ca
ignore all the options related to the indexer 2021-06-21 18:13:00 +02:00
Tamo 1cf9f43dfe
fix the tests 2021-06-21 16:34:49 +02:00
Tamo 2097554c09
fix the cli 2021-06-21 16:34:49 +02:00
marin postma 56686dee40
review changes 2021-06-21 13:57:32 +02:00
marin postma 763ee521be
fix rebase errors 2021-06-21 12:11:09 +02:00
marin postma 0bfdf9a785
bump milli 2021-06-21 12:11:09 +02:00
marin postma fa573dabf0
fmt 2021-06-21 12:11:09 +02:00
marin postma abdf642d68
integrate milli errors 2021-06-21 12:11:08 +02:00
marin postma 0dfd1b74c8
fix tests 2021-06-21 12:11:08 +02:00
marin postma 0d3fb5ee0d
factorize internal error macro 2021-06-21 12:11:08 +02:00
marin postma 02277ec2cf
reintroduce anyhow 2021-06-21 12:11:06 +02:00
marin 8fc12b1526
Update meilisearch-http/src/index/search.rs
Co-authored-by: Clément Renault <clement@meilisearch.com>
2021-06-21 11:06:06 +02:00
marin postma 439db1aae0
enable response error for search routes 2021-06-21 11:00:14 +02:00
marin postma 8afbb9c462
enable response error for documents routes 2021-06-21 10:59:41 +02:00
marin postma 5c52a1393f
enable response error for settings routes 2021-06-21 10:59:41 +02:00
marin postma 112cd1787c
change error message for uuid resolver 2021-06-21 10:59:40 +02:00
marin postma d1550670a8
enable response error for index routes 2021-06-21 10:59:40 +02:00
marin postma 58f9974be4
remove anyhow refs & implement missing errors 2021-06-21 10:59:38 +02:00
marin postma 3a2e7d3c3b
optimize cropping 2021-06-20 16:59:31 +02:00
bors[bot] c1b6f0e833
Merge #183
183: Add cropping and update `_formatted` behavior r=curquiza a=MarinPostma

TODO:
- [x] Solves #5 
- [x] Solves #203 
- [x] integrate the new milli highlight (according to the query words)

Co-authored-by: Marin Postma <postma.marin@protonmail.com>
Co-authored-by: Clémentine Urquizar <clementine@meilisearch.com>
2021-06-18 11:18:37 +00:00
Clémentine Urquizar 5d8a21b0de
Fix clippy errors 2021-06-17 18:51:07 +02:00
Clémentine Urquizar 9e8888b603
Fix clippy errors 2021-06-17 18:50:18 +02:00
Clémentine Urquizar 623b71e81e
Fix clippy errors 2021-06-17 18:02:25 +02:00
Clémentine Urquizar c5c7e76805
Update meilisearch-http/src/index/search.rs
Co-authored-by: marin <postma.marin@protonmail.com>
2021-06-17 18:00:02 +02:00
Clémentine Urquizar e4b3d35ed8
Fix clippy errors 2021-06-17 17:03:43 +02:00
Clémentine Urquizar 33e55bd82e
Refactor the crop 2021-06-17 16:59:01 +02:00
Clémentine Urquizar 9543ab4db6
Use mut instead of returning the hashmap 2021-06-17 13:51:27 +02:00
Clémentine Urquizar 97909ce56e
Use BTreeMap and remove ids_in_formatted 2021-06-16 19:30:06 +02:00
bors[bot] 2f2484e186
Merge #212
212: bump milli to 0.4.0 r=MarinPostma a=MarinPostma



Co-authored-by: marin postma <postma.marin@protonmail.com>
2021-06-16 15:42:34 +00:00
bors[bot] 2062b10b79
Merge #209
209: Integrate amplitude r=MarinPostma a=irevoire

And merge the sentry and amplitude usage under one “Enable analytics” flag

closes #180


Co-authored-by: Tamo <tamo@meilisearch.com>
Co-authored-by: Irevoire <tamo@meilisearch.com>
2021-06-16 15:25:31 +00:00
Clémentine Urquizar a0b022afee
Add Cow 2021-06-16 17:25:02 +02:00
marin postma 5a47cef9a8
bump milli to 0.4.0 2021-06-16 17:15:56 +02:00
Clémentine Urquizar 9538790b33
Decompose into two functions 2021-06-16 17:13:21 +02:00
Tamo 4e2568fd6e
disable amplitude on debug build 2021-06-16 17:12:49 +02:00
Clémentine Urquizar dc5a3d4a62
Use BTreeSet instead of HashSet 2021-06-16 16:20:10 +02:00
Clémentine Urquizar 7b02fdaddc
Rename functions 2021-06-16 14:23:08 +02:00
Irevoire c0d169e79e
Apply suggestions from code review
Co-authored-by: Clémentine Urquizar <clementine@meilisearch.com>
2021-06-16 11:12:46 +02:00
Clémentine Urquizar 9840b5c7fb
Refacto 2021-06-15 18:44:56 +02:00
Clémentine Urquizar 1ef061d92b
Fix clippy errors 2021-06-15 17:40:45 +02:00
Clémentine Urquizar 79a1212ebe
Do intersection with displayed ids instead of checking in loop 2021-06-15 17:40:45 +02:00
Clémentine Urquizar 8d0269fcc4
Create function to create fomatted_options 2021-06-15 17:40:45 +02:00
Clémentine Urquizar 5e656bb58a
Rename parse_facets into parse_filter 2021-06-15 17:40:45 +02:00
Clémentine Urquizar d9c0190497
Redo to_retrieve_ids 2021-06-15 17:40:45 +02:00
Clémentine Urquizar 5dffe566fd
Remove useless comments 2021-06-15 17:40:45 +02:00
Clémentine Urquizar b769877183
Make it compatible with the new milli highlighting 2021-06-15 17:40:44 +02:00
Clémentine Urquizar 446b66b0fe
Fix cargo clippy error 2021-06-15 17:40:44 +02:00
Clémentine Urquizar d0ec081e49
Refacto 2021-06-15 17:40:44 +02:00
Clémentine Urquizar 65130d9ee7
Change crop_length type from Option(usize) to usize 2021-06-15 17:40:44 +02:00
Clémentine Urquizar 638009fb2b
Rename highlighter variable into formatter 2021-06-15 17:40:44 +02:00
Clémentine Urquizar 7f84f59472
Reorganize imports 2021-06-15 17:40:44 +02:00
Clémentine Urquizar 4f8c771bb5
Add new line 2021-06-15 17:40:43 +02:00
Clémentine Urquizar 9e69f33f3c
Fix clippy errors 2021-06-15 17:40:43 +02:00
Clémentine Urquizar 0da8fa115e
Add custom croplength for attributes to crop 2021-06-15 17:40:43 +02:00
Clémentine Urquizar 811bc2f421
Around to previous word 2021-06-15 17:40:43 +02:00
Clémentine Urquizar caaf8d3f40
Fix tests 2021-06-15 17:40:43 +02:00
Marin Postma 7473cc6e27
implement crop around 2021-06-15 17:40:43 +02:00
Marin Postma 56c9633c53
simple crop before 2021-06-15 17:40:43 +02:00
Clémentine Urquizar 93002e734c
Fix tests 2021-06-15 17:40:42 +02:00
Clémentine Urquizar 60f6d1c373
First version of highlight after refacto 2021-06-15 17:40:42 +02:00
Clémentine Urquizar a03d9d496e
Fix compilation errors 2021-06-15 17:40:42 +02:00
Marin Postma 7904637893
crop skeleton 2021-06-15 17:40:42 +02:00
Tamo def1596eaf
Integrate amplitude
And merge the sentry and amplitude usage under one “Enable analytics”
flag
2021-06-15 15:36:30 +02:00
Clémentine Urquizar fe5a494035
Update alpha for the next release 2021-06-14 17:55:04 +02:00
marin postma a780cff8fd
fix clippy warning 2021-06-14 14:53:47 +02:00
Tamo 7cb2dcbdf8
add a comment 2021-06-14 14:47:53 +02:00
Tamo f068d7f978
makes clippy happy 2021-06-14 14:47:53 +02:00
Tamo 18d4d6097a
implements the synonyms in transplant 2021-06-14 14:47:51 +02:00
bors[bot] b119bb4ab0
Merge #197
197: Update milli (v0.3.1) with filterable attributes r=MarinPostma a=curquiza

Fixes #187 and #70
Also fixes #195 

Co-authored-by: Clémentine Urquizar <clementine@meilisearch.com>
2021-06-14 12:19:42 +00:00
bors[bot] d65b5db97f
Merge #144 #173
144: Concurrent update run loop (refactor) r=MarinPostma a=MarinPostma

This PR allows multiple request to the update store to be performed concurently (i.e, one can list updates while an updates in being written to the update store).


173: Convert UpdateStatus to legacy meilisearch format r=MarinPostma a=MarinPostma

Returns the update statuses with the same format as legacy meilisearch.

The number of documents in a document addition/deletion is not known before processing, so it is only returned when the update is `processed`.

close #78 

associated milli PR: https://github.com/meilisearch/milli/pull/178


Co-authored-by: marin postma <postma.marin@protonmail.com>
Co-authored-by: Marin Postma <postma.marin@protonmail.com>
2021-06-14 11:30:44 +00:00
Clémentine Urquizar d4be4d80db
Fix after rebase 2021-06-14 13:27:18 +02:00
Clémentine Urquizar 9996c59183
Update with milli 0.3.1 2021-06-14 13:20:43 +02:00
Clémentine Urquizar 88bf867a3e
Rename attributes for faceting into filterable attributes 2021-06-14 13:20:43 +02:00
Clémentine Urquizar 7009906d55
Update reset-all-settings test 2021-06-14 13:20:43 +02:00
Clémentine Urquizar ca1bb7dc1c
Fix tests 2021-06-14 13:20:43 +02:00
Clémentine Urquizar aa04124bfc
Add changes according to milli update 2021-06-14 13:20:37 +02:00
Marin Postma 11c81ab4cb
fix tests 2021-06-14 11:17:49 +02:00
marin postma 0f767e3743
conccurrent update run loop 2021-06-14 10:57:14 +02:00
bors[bot] 1e659bb17b
Merge #194
194: Bump sentry version r=MarinPostma a=irevoire

closes #102 

Co-authored-by: tamo <tamo@meilisearch.com>
2021-06-14 08:34:04 +00:00
Marin Postma e8bd5ea4e0
convert UpdateStatus to legacy meilisearch format 2021-06-14 10:21:57 +02:00
bors[bot] d765397c82
Merge #179
179: Enable filter paramater during search r=MarinPostma a=MarinPostma

This pr makes the necessary changes to transplant in accordance with the specification on filters.

More precisely, it:
- Removes the `filters` parameter
- Renames `facetFilters` to `filter`
- Allows either a string or an array to be passed to the filter param.

It doesn't allow the mixed syntax, that needs to be handled by milli.

close #81
close #140


Co-authored-by: Marin Postma <postma.marin@protonmail.com>
2021-06-14 08:11:30 +00:00
mpostma 3ef0830c5d review changes 2021-06-10 16:11:52 +02:00
mpostma eb7616ca0f remove dbg 2021-06-10 16:03:48 +02:00
mpostma 592fcbc71f fix stats test 2021-06-10 16:03:48 +02:00
Irevoire 20e1caef47 makes clippy happy 2021-06-10 16:03:48 +02:00
mpostma 2d19b78dd8 fix stats test 2021-06-10 16:03:48 +02:00
Irevoire 99551fc21b fix encoding bug 2021-06-10 16:03:48 +02:00
mpostma 2716c1aebb fix update store lock 2021-06-09 16:19:45 +02:00
mpostma 1a65eed724 fix index creation bug 2021-06-09 11:52:36 +02:00
marin postma 75c0718691
fix update loop infinite loop 2021-06-02 17:29:50 +02:00
Tamo 2d7785ae0c
remove the dump_batch_size option from the CLI 2021-06-01 20:42:06 +02:00
Tamo d0552e765e
forbid deserialization of Setting<Checked> 2021-06-01 20:41:45 +02:00
marin df6ba0e824
Apply suggestions from code review
Co-authored-by: Irevoire <tamo@meilisearch.com>
2021-06-01 11:18:37 +02:00
Marin Postma 6609f9e3be review edits 2021-05-31 18:41:37 +02:00
Marin Postma 1c4f0b2ccf
clippy, fmt & tests 2021-05-31 16:03:39 +02:00
Marin Postma 10fc870684
improve dump info reports 2021-05-31 15:49:04 +02:00
tamo dffbaca63b
bump sentry version 2021-05-31 13:59:31 +02:00
Marin Postma b3c8f0e1f6
fix empty index error 2021-05-31 10:58:51 +02:00
Marin Postma bc5a5e37ea
fix dump v1 2021-05-31 10:42:31 +02:00
Marin Postma 33c6c4f0ee
add timestamos to dump info 2021-05-30 15:55:17 +02:00
Marin Postma 39c16c0fe4
fix dump import 2021-05-30 12:35:17 +02:00
Marin Postma 1cb64caae4
dump content is now only uuid 2021-05-29 00:08:17 +02:00
Marin Postma b258f4f394
fix dump import 2021-05-27 14:30:20 +02:00
Marin Postma c47369839b
dump meta 2021-05-27 10:51:19 +02:00
Marin Postma b924e897f1
load index dump 2021-05-27 10:27:47 +02:00
Marin Postma e818c33fec
implement load uuid_resolver 2021-05-26 20:42:09 +02:00
Marin Postma 9278a6fe59
integrate in dump actor 2021-05-25 18:14:11 +02:00
Marin Postma 3593ebb8aa
dump updates 2021-05-25 16:44:58 +02:00
Marin Postma 464639aa0f
udpate actor error improvements 2021-05-25 16:44:58 +02:00
Marin Postma 4acbe8e473
implement index dump 2021-05-25 16:44:58 +02:00
Marin Postma 7ad553670f
index error handling 2021-05-25 16:44:58 +02:00
Marin Postma 2185fb8367
dump uuid resolver 2021-05-25 16:44:54 +02:00
tamo 89846d1656
improve panic message 2021-05-25 15:47:57 +02:00
tamo 1a6dcec83a
crash when the actor have no inbox 2021-05-25 15:23:13 +02:00
tamo 991d8e1ec6
fix the error printing 2021-05-25 10:48:57 +02:00
tamo 49a0e8aa19
use a RwLock instead of a Mutex 2021-05-24 18:19:34 +02:00
tamo 912f0286b3
remove the dump_inner trickery 2021-05-24 18:06:20 +02:00
tamo dcf29e1081
fix the error handling in case there is a panic while creating a dump 2021-05-24 17:33:42 +02:00
tamo 529f7962f4
handle parallel requests for the dump actor 2021-05-24 15:42:12 +02:00
tamo 8a11c6c429
Implements the legacy behaviour of the dump
When asked if a dump exists we check if it's the current dump, and if
it's not then we check on the filesystem for any file matching our
`uid.dump`
2021-05-24 12:35:46 +02:00
tamo 4cbf866821
merge with main 2021-05-12 18:12:37 +02:00
tamo e0e23636c6
fix the serializer + reformat the file 2021-05-12 17:04:24 +02:00
Marin Postma 295f496e8a
atomic index dump load 2021-05-12 16:21:37 +02:00
tamo 6d837e3e07
the route to create a dump must return a 202 2021-05-11 17:34:34 +02:00
Marin Postma 1b671d4302
fix-snapshot 2021-05-11 13:57:18 +02:00
tamo c30b32e173
add the criterion attribute when importing dumps from the v1 2021-05-11 13:21:36 +02:00
tamo 9e798fea75
fix the import of dump without unprocessing updates 2021-05-11 13:03:47 +02:00
tamo 384afb3455
fix the way we return the settings 2021-05-11 11:47:04 +02:00
tamo 92a7c8cd17
make clippy happy 2021-05-11 00:27:22 +02:00
tamo 8b7735c20a
move the import of the updates in the v2 and ignore the v1 for now 2021-05-11 00:20:55 +02:00
tamo 7d748fa384
integrate the new Settings in the dumps 2021-05-10 20:48:06 +02:00
tamo d767990424
fix the import of the updates in the dump 2021-05-10 20:25:12 +02:00
tamo ef438852cd
fix the v1 2021-05-10 20:25:12 +02:00
tamo 40ced3ff8d
first working version 2021-05-10 20:25:12 +02:00
tamo 5f5402a3ab
provide a way to access the internal content path of all processing State 2021-05-10 20:25:12 +02:00
tamo 26dcb9e66d
bump milli version and fix a performance issue for large dumps 2021-05-10 20:25:12 +02:00
Marin Postma 956012da95
fix dump lock 2021-05-10 20:25:12 +02:00
tamo 24192fc550
fix tests 2021-05-10 20:25:12 +02:00
tamo efca63f9ce
[WIP] rebase on main 2021-05-10 20:25:09 +02:00
tamo c3552cecdf
WIP rebase on main 2021-05-10 20:24:18 +02:00
tamo 0f94ef8abc
WIP: dump 2021-05-10 20:24:18 +02:00
tamo 0275b36fb0
[WIP] rebase on main 2021-05-10 20:24:14 +02:00
tamo 1b5fc61eb6
[WIP] rebase on main 2021-05-10 20:23:12 +02:00
tamo 0fee81678e
[WIP] rebase on main 2021-05-10 20:22:18 +02:00
tamo c4d898a265
split the dumps between v1 and v2 2021-05-10 20:20:57 +02:00
tamo e389c088eb
WIP: rebasing on master 2021-05-10 20:20:57 +02:00
Marin Postma 0cc79d414f
add test 2021-05-10 18:34:25 +02:00
Marin Postma 8d11b368d1
implement check 2021-05-10 18:22:41 +02:00
Marin Postma 706643dfed
type setting struct 2021-05-10 17:30:09 +02:00
Marin Postma b192cb9c1f
enable string syntax for the filters 2021-05-06 12:48:31 +02:00