Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
125 commits
Select commit Hold shift + click to select a range
24b36da
Lengthy battle with borrow checker
Nov 4, 2016
be586e9
Push current state
vmx Nov 7, 2016
d6ee2f7
Adding array and bool filter
vmx Nov 7, 2016
9a2c3e3
Adding factor filter
vmx Nov 7, 2016
3cdf4dc
Implement build_filter()
vmx Nov 7, 2016
87ebf58
Add capnp as required dependencies (#1)
daschl Nov 8, 2016
a3a26fd
Merge branch 'master' of github.com:pipedown/noise
vmx Nov 8, 2016
6800c93
Compiles with Spacejam's rust-rocksdb
vmx Nov 8, 2016
e79fba3
Fix parsing problems with string literals and whitespace
vmx Nov 8, 2016
1e1ee45
Fix unit tests
vmx Nov 8, 2016
479e902
Deal with empty objects properly
vmx Nov 8, 2016
b6aa2a5
First query works
vmx Nov 9, 2016
48c96c5
Use rust-rocksdb fork based on Spacejams one.
vmx Nov 9, 2016
8c650af
Fix tests
vmx Nov 9, 2016
6348c6f
Rewrite common_prefix_len to use idiomatic iterators.
daschl Nov 8, 2016
39f6ec2
Finish simple empty object test
vmx Nov 9, 2016
d5b1b1c
Fixed typo
vmx Nov 9, 2016
7b5f571
Keep src dir clean from test data
daschl Nov 10, 2016
6f076e4
ignore intellij project files
daschl Nov 10, 2016
d08f767
Move Error struct into its own module
vmx Nov 9, 2016
b790f61
Forgot to check in the error.rs
vmx Nov 10, 2016
03d5848
Changes to word stemming
Nov 11, 2016
867964b
Fixed broken tests in stems.rs
Nov 11, 2016
4ad195d
Got rid of compile warnings of unused result
Nov 11, 2016
40ff067
Strip off keyspace byte from get_next_id result string
Nov 11, 2016
3b478b7
Simplify whitespace method in query parser
Nov 11, 2016
1efbe37
Added support for escaping special chars in string literals
Nov 11, 2016
2d854ff
Fix bug when array ends
vmx Nov 11, 2016
3dd1e3a
Make queries work
vmx Nov 12, 2016
e53d557
Remove commented out code
vmx Nov 12, 2016
456d498
Tests work again
vmx Nov 12, 2016
98e3323
Switch to stock rust-rocksdb
vmx Nov 13, 2016
6427eca
Stock unicode-segmentation can be used
vmx Nov 13, 2016
ba56cfe
added peg parser grammar to a comment
Nov 17, 2016
6058be2
Split up word index keys to be one key per nested repeated field
Nov 29, 2016
2929706
fixed comment
Dec 1, 2016
c779e02
Fix JSON shredder tests
vmx Dec 6, 2016
4c6f19e
Store non-inverted document bodies
Dec 7, 2016
c3c3c42
Merge pull request #10 from vmx/fix-shredder-tests
Damienkatz Dec 7, 2016
d3a9132
Merge Pull Request: Use rust-rocksdb 0.5.0
Dec 7, 2016
6e3463b
Merge branch 'vmx-rust-rocksdb-0.5.0'
Dec 7, 2016
0f3f92e
Fix broken tests by making mut ref
Dec 7, 2016
1fcf73a
New example based syntax
Dec 14, 2016
bf29a1b
Add test for || (or) Operator
Dec 14, 2016
865ec4c
Change potentially confusing name of struct to FilterWithResult
Dec 15, 2016
c3c3431
Optimization to avoid string allocation/construction in filter first_…
Dec 16, 2016
d35b11e
new query operator ~=
Dec 18, 2016
3dcb411
Move QueryRuntimeFilters into new file filters.rs
Dec 20, 2016
776c1ed
Add return clause to extract data and format from documents
Dec 24, 2016
68e38f3
Losslessly store all json types
Dec 24, 2016
2b1827d
Fix broken unit tests
Dec 24, 2016
46da627
Fix parsing object paths to disallow strings in the wrong place.
Dec 24, 2016
a24bf7c
added group, sort, avg, sum, min, max, count, concat, list
Dec 31, 2016
165fcf0
Moved Parser and JsonValue out of query.rs and into separate files
Dec 31, 2016
a23e1f7
Bind variable first implementation
Jan 2, 2017
dac305a
relevancy scoring and boosting
Jan 7, 2017
c33d06b
Logical Not (!) support
Jan 13, 2017
c10c2f1
Removed obsolete grammar
Jan 13, 2017
64be823
Added tests for boolean precedence
Jan 13, 2017
c381085
Switched ExactMatchFilter to use the already stored fields
Jan 13, 2017
62cd2c4
Reenable tests in json_shred and remove dead code in stemmer
Jan 13, 2017
1305ec8
Normalize object keys in key_builder
Jan 13, 2017
1f2075c
Added test scripts with simple commands
Jan 16, 2017
05c7bf4
Move Returnables into their own files and added comments
Jan 16, 2017
5aedfcc
Preserve ordering of sort clause
Jan 16, 2017
27ab79b
Removed code that ignores fields starting with underscore.
Jan 17, 2017
a0b0e26
delete and update docs, missing _id support
Jan 17, 2017
1eddff3
Fixed bug where trailing unnormalized text causes panic
Jan 18, 2017
eec3618
Change stemmer to return non-alpha chars if whole sting is non-alpha
Jan 18, 2017
5b64302
flush uncommitted data on close from repl
Jan 18, 2017
f7f9088
Simplified stemming code
Jan 26, 2017
a4904d3
Small optimization and formatting changes
Jan 26, 2017
b4328e2
Added ability to return object values nested in arrays as arrays
Feb 4, 2017
b22c31b
Aggregates now work on arrays
Feb 13, 2017
c6dc65e
Abstract out details of rocksdb snapshot/iterators from filters
Feb 17, 2017
5f1bf60
Move aggregate code out of query.rs and into own module
Feb 17, 2017
edffaf4
Move all rocksdb specific code into snapshot.rs
Feb 24, 2017
67ac3dd
Avoid recompile when running `cargo test`
Feb 28, 2017
49a0272
remove normalization of json keys
Feb 28, 2017
5589f9a
Make a proper importable library Cargo crate
Mar 10, 2017
3947f60
Add Damien as a project author
Mar 10, 2017
67ba5f1
Change name of crate and lib to noise_search
Mar 10, 2017
f52f7ef
Remove WriteOptions from struct Index
Mar 31, 2017
b817af9
Remove WriteBatch from Index
Mar 31, 2017
d21eea7
Export rocksdb::batch
Apr 1, 2017
7434420
Fix batch to WriteBatch
Apr 1, 2017
0ac8e5b
New Batch type
Apr 2, 2017
4000f77
Fix broken test
Apr 3, 2017
e6850e6
Add support for getting filename
Apr 3, 2017
188e3f9
Fix panic that occurs when Parser::must_consume runs out of string
Apr 4, 2017
aee2c02
Make code clearer
vmx Apr 6, 2017
4c7f332
Make comments doc comments
vmx Apr 4, 2017
aee89d2
Refactor json_primitive function
vmx Apr 4, 2017
cca2cfb
Rename `add_entries` to `add_stemmed_entries()` for clarity
vmx Apr 6, 2017
d6f3b29
Exact match for numbers (without scoring)
vmx Apr 13, 2017
594b011
Add less than and greater than (equal) filter for numbers
vmx Apr 18, 2017
1e36421
BREAKING CHANGE: Rename count_key prefix from 'F' to 'C'
vmx Apr 19, 2017
12abb2e
Don't repeat yourself refactoring
vmx Apr 18, 2017
e8c8982
Extend comparison function to other types
vmx Apr 19, 2017
c9d5efb
Add exact match filter for booleans and null
vmx Apr 19, 2017
955a5ff
Run repl tests ordered by last modified date
vmx Apr 19, 2017
e905abf
rustfmt run on source files
Apr 24, 2017
bef2926
Change sort clause to order clause
Apr 25, 2017
59858d4
Bump version
Apr 25, 2017
99ecaa2
Fix test updater to point to correct executable
Apr 26, 2017
22730e6
Fix for issue #21 `default` return with single digit doesn't work
Apr 26, 2017
7b75c67
Scoring for comparison operators
Apr 27, 2017
65c0bd9
fix for empty doc problem
Apr 28, 2017
fc0ac2e
Bump version for bug fix.
Apr 28, 2017
8a85211
Fix for key prefix bug #24
May 3, 2017
fc7a961
Fix limit when results aren't sorted or grouped
May 3, 2017
4d82ee3
Add `find *` to allow the returning of every document in the index
May 4, 2017
d59798c
Bump version number
May 4, 2017
24bad63
Syntax changes, get rid of `*`
May 5, 2017
2b134eb
Bump version
May 5, 2017
e73c30d
Documentation for query language
May 8, 2017
ac433a8
Fix operator spacing and bad json code spec
Damienkatz May 8, 2017
b0ed727
Add link to query language reference
Damienkatz May 8, 2017
1aed830
Bump version number
May 8, 2017
3f43618
Fix serious performance problem with count()
May 9, 2017
aa2de27
bump version number for performance bug fix
May 9, 2017
0fe09cb
Ensure successful cargo build before updating repl-tests
May 21, 2017
a30dbe4
change !== to != and bug fix
May 21, 2017
94bb988
bump version to 0.5.0 for logical not operator fix
May 24, 2017
f198786
Add workaround to "only logical nots" limitation
vmx May 25, 2017
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,2 +1,8 @@
target
Cargo.lock

**/*.iml
.idea/
*.reject
.DS_Store

30 changes: 13 additions & 17 deletions Cargo.toml
Original file line number Diff line number Diff line change
@@ -1,29 +1,25 @@
[package]
name = "noise"
version = "0.1.0"
authors = ["Volker Mische <[email protected]>"]
name = "noise_search"
version = "0.5.0"
authors = ["Damien Katz <[email protected]>", "Volker Mische <[email protected]>"]
repository = "https://github.com/pipedown/noise.git"
homepage = "https://github.com/pipedown/noise.git"
homepage = "http:/noisesearch.org"
license = "MIT OR Apache-2.0"
readme = "README.md"
description = "Nested Object Inverted Search Engine"
build = "build.rs"

[lib]
name = "noise_search"
crate-type = ["lib"]


[dependencies]
capnp = "0.7.4"
rustc-serialize= "0.3.19"
rustc-serialize = "0.3.19"
stemmer = "0.3.2"
unicode-normalization = "0.1.2"
unicode-segmentation = "0.1.2"
rocksdb = "0.6.0"
varint = "0.9.0"
uuid = { version = "0.3", features = ["v4"] }

[dependencies.rocksdb]
git = "https://github.com/vmx/rust-rocksdb.git"
branch = "vmx"

[dependencies.unicode-segmentation]
git = "https://github.com/vmx/unicode-segmentation.git"
branch = "unicode-word-indices"


[build-dependencies]
capnpc = "0.7.2"
3 changes: 3 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,8 @@ nature of JSON, and will allow:
* Case sensitive exact word and sentence match
* Arbitrary boolean nesting
* Greater than/less Than matching

[Query Langauge Reference here](https://github.com/pipedown/noise/blob/master/query_language_reference.md)


Installation
Expand All @@ -21,6 +23,7 @@ Installation
### Dependencies

* [RocksDB](http://rocksdb.org/)
* [capnp-tool](https://capnproto.org/capnp-tool.html)


### Build
Expand Down
4 changes: 2 additions & 2 deletions build.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
extern crate capnpc;

fn main() {
::capnpc::compile("capnp", &["capnp/records.capnp"]).unwrap();
println!("cargo:rerun-if-changed=src/");
println!("cargo:rerun-if-changed=tests/");
}
11 changes: 0 additions & 11 deletions capnp/main.rs

This file was deleted.

21 changes: 0 additions & 21 deletions capnp/records.capnp

This file was deleted.

Loading