Commit Graph

373 Commits

Author SHA1 Message Date
seagle 98dc91efef
fix protobuf Checkstyle (#1881) 2022-06-08 19:17:07 +08:00
zyxxoo 2af01bc92d
Add system schema store (#1891)
* Add meta table into system store
* Add system schema store
* Add test case for read version
* Let AbstractBackendStore impl default storedVersion()
* fix small bug og HugeProject
* add test for SystemSchemaStore
* fix initStore schema missed

Change-Id: I5c9d65c4ae022cb84592e8f2aa57bd7485cd12e4
Co-authored-by: liningrui <liningrui@baidu.com>
2022-06-02 16:42:46 +08:00
ShouJing 1118418585
fix: fix ProfileApi url check (#1893) 2022-05-28 13:52:31 +08:00
Simon Cheung 88d71e75b1
chore: replace `APPLICATION_JSON` with `TEXT_PLAIN` in dynamic create graph api (#1888) 2022-05-18 17:39:55 +08:00
wangyao 335f0ea4f0
feat: support swagger UI to viewing API (#1880)
implement #1879
Co-authored-by: Yao Wang <wangyao_yewu@cmss.chinamobile.com>
2022-05-16 20:19:00 +08:00
Linary 8609968e66
Improve some action for install snapshot and add peer (#1527)
1. Fix bug that relative path need normalize when load snapshot
2. Use zip decompresser since decompress tar file may lead dead loop
3. Move raft.group_peers from graph-config into rest-server-config
4. Pass raft.endpoint and raft.group_peers from server to core
5. Let RestServer start before GremlinServer
6. Use read-index to ensure the raft log caught up for new node
7. Let add_peer and remove_peer API work in async job
8. Use shared rpc server and delete raft.endpoint

Change-Id: I7de3d98cb51c3b7c32a4f19a0d99ed622f78d331
Co-authored-by: Zhangmei Li <lizhangmei@baidu.com>
2022-05-16 19:34:25 +08:00
wangyao 239b06e8b0
improve allow role for drop graph (#1878)
Co-authored-by: Yao Wang <wangyao_yewu@cmss.chinamobile.com>
2022-05-13 16:59:43 +08:00
Jade Peng cd09304f39
feat: support query data by use cypher language (#1866)
implement #1748

Co-authored-by: jadepeng <jqpeng@iflytek.com>
2022-05-12 14:38:56 +08:00
Fizell be7c0838a5
fix hugegraph-api code checkstyle (#1851) 2022-04-26 16:19:13 +08:00
zyxxoo 85b01b2333
chore: java 11 version support (#1653) 2022-04-25 19:13:30 +08:00
Jermy Li 8d52abb2a0
HugeGraph-622: Bump up to version 0.13.0 (#1740) 2022-04-21 14:15:46 +08:00
zyxxoo d778eb1383
Fix close exception and server-info EXPIRED_INTERVAL (#1804) 2022-04-07 12:57:50 +08:00
Simon 7acd4fc0e4
Add `graphs.enable_dynamic_create_drop` option (#1809) 2022-04-06 17:46:42 +08:00
Josh Soref 5368f3205e
Spelling corrections (#1798)
Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
Co-authored-by: Josh Soref <jsoref@users.noreply.github.com>
2022-03-30 17:12:18 +08:00
imbajin b591f7d8b3
refact: fix some bugs & clean code (#1741)
* feat(api): Support adamic-adar & resource-allocation algorithms

* split into 2 class

* enhance a string of code logic

* keep NO_LIMIT now

* Update EdgeStep.java

Co-authored-by: imbajin <imbajin@users.noreply.github.com>
2022-03-21 17:26:38 +08:00
imbajin 0ca54c4097
feat(api): support adamic-adar & resource-allocation algorithms (#1763) 2022-03-18 12:07:31 +08:00
Jermy Li 5bb860f2d2
Fix unexpected task status (#1767)
* fix unexpected task status

* fix task-manager become single-node mode due to server-info is missing

* fix don't auto save server-info on master node

* fix: create index label task
2022-03-11 17:40:15 +08:00
zhoney 6856cc21b0
fix edge batch update error (#1776)
Change-Id: I8742ca0e128e3c9bc3eb2ef99a52276045e17b79
2022-03-10 12:08:40 +08:00
imbajin e9cef7425d
fix: useless ring detection removed valid path (#1723)
* remove useless ring detection due to it will remove valid path
* limit max depth to 5000 to avoid stackoverflow
2022-01-12 20:08:59 +08:00
Jermy Li ace60537d0
improve raft module and test (#1721)
* improve raft moddule
* add raft-server test
* set safe_read=true and use_snapshot=false
* fix leader not wait for apply-task
* add auth support to raft-tools.sh
* don't clear non-shared-storage backend
* set task timer interval from 3s to 1s
* improve CachedSchemaTransaction
* improve update schema status
* remove truncate from project test
* fix codecov: api test report not been uploaded
* improve task cancel() test with cancelled status

Change-Id: I016d3fcc4ab50614afdf452e7c9691ee3cc3c70b
2022-01-12 16:00:58 +08:00
Jermy Li 6924f36346
support hot set trace through /exception/trace API (#1727)
Change-Id: I78bbff56420be0a7c99dfc461913ed45d66725fc
2022-01-12 14:05:33 +08:00
zhoney f19acccbf1
upgrade rpc and common version to 2.0.1 (#1719)
Change-Id: If90b56013b04f1e72de18dcd733471ef42955f98
2021-12-31 20:07:07 +08:00
Jermy Li 8eea685f02
fix dynamic graph not bind to gremlin (#1716) 2021-12-31 09:52:23 +08:00
Jermy Li 26413a8327
optimize query perf (#1711)
* add OneIdQuery and idsSize() method
* change IdQuery.ids and ConditionQuery.conditions to list type
* JsonVertex.properties() only copy array if needed

Change-Id: I711a9c498c688ce31f6df5973b68027a69b063fa
2021-12-28 19:21:22 +08:00
Jermy Li 0580bae3e5
support clone graph without config param (#1709)
Change-Id: I738237035438590b8c9414dd1281f950a3f2b7bd
2021-12-27 17:09:28 +08:00
Jermy Li b6abf96040
fix: can't dynamic create graph if auth enabled (#1708)
Change-Id: I9f6c62d9eb152e7b6a45a078ae28f9a41828ae40
2021-12-27 14:22:23 +08:00
Linary d213166eb2
Support to create graph dynamically (#1065)
* Support to create graph dynamically
* merge gremlin-server graphs and specified graphs
* Just use graphs directory as the graph source
* use notify() instead of call() of Eventhub for graph add/remove
* merge clone graph into create graph

Implement #165

Change-Id: I03d3e606d6292acec46a7725094c05fe84a6c9cd

Co-authored-by: zhangyi51 <zhangyi51@baidu.com>
2021-12-24 19:25:11 +08:00
Jermy Li 997353dbee
remove truelicence dependency (#1700)
Change-Id: Ifbae8ea27041baaf3719f3a5ef84a1ec33010858
2021-12-21 11:51:55 +08:00
imbajin 9f50e67983
refact: params improve for personal rank api (#1695) 2021-12-15 19:33:56 +08:00
zhoney f529c62226
update property create and update http return code (#1584)
Change-Id: I252f5cab53c2f0de8506342cfb7c9ab0178fc1d6
2021-08-25 18:00:27 +08:00
zhoney 69ac3cc072
support schema-api to return all schema of a graph (#1567)
* upgrade api version to 0.66

Change-Id: I37ca09dcedfd81612f470ef8661effe35323c223
2021-08-18 14:52:03 +08:00
Jermy Li e7a6e62922
optimize kout/kneighbor count (avoid copying set) (#1550)
* concurrentDepth() ignore direction
* use list instead of set for ids since no duplicate id

Change-Id: I4e775b77964980644b08d8569315b4ab9af0701f
2021-08-02 17:56:51 +08:00
zhoney ef37b3ac96
support olap writeback for cassandra and rocksdb (#1506)
* support olap writeback for cassandra and rocksdb
* add olap property key tests
* clear vertex cache when olap pk changed
* support config data disk for olap pk when using rocksdb backend
* rename read frequency to write type

Change-Id: I947c3a96eb7aa67ee9eff5f7fb248e9f4539e91b
2021-07-22 23:53:49 +08:00
zyxxoo 379859a441
refactor: optimizing code of project update api (#1537) 2021-07-14 11:59:50 +08:00
zyxxoo 6bff777a51
feat: support auth-project api (#1504) 2021-07-07 14:35:48 +08:00
imbajin 23beacd2bc
refact: invalidate auth client cache & merge auth filter log (#1528)
* refact: invalidate auth client cache & merge auth filter log

1. merge auth filter log into audit.log
2. invalidate auth client role cache with CUD operation
2021-06-30 16:38:02 +08:00
zhoney 08170eb1cc
fix same neighbor limit from 10 to 10000000 (#1530)
Change-Id: I28ac292b23c9cb37e786a6b60530124b39eb9b3f
2021-06-30 16:37:32 +08:00
Linary f41c6e9fdb
Add log when occured license operation error (#1522)
Change-Id: I067b9c21747902ca0f78b1508b4b9ce7b0b2265e
2021-06-28 15:27:26 +08:00
imbajin f22d03fdd6
refact(auth): cache login role in auth client to avoid sending rpc repeatedly (#1507)
* refact(auth): cache login role in auth client to avoid sending rpc repeatedly
* fix: don't create Id every time
* perf: remove useless toLowerCase
* add config for expire time in auth client
* fix StandardAuthManager.inputPassword in auth client
* add option for auth max_capacity
* unified cache_capacity & expired time (also separate invalid cache for pwd)
* add option for token expiration

Co-authored-by: guoshoujing <guoshoujing@baidu.com>
2021-06-25 21:52:40 +08:00
ShouJing 9ee9fe12f3
feat: implement auth login + token (#1500) 2021-06-24 22:50:53 +08:00
Linary d0e0d3d9df
Use github action to run ci (#1514)
Change-Id: Ic77c4ee09f3375252b611c8f3e282a5be5499dcd
2021-06-24 19:00:48 +08:00
imbajin 0c51de548c
feat(auth): support rate limit per user for audit log (#1493) 2021-06-21 21:46:13 +08:00
Jermy Li bc9a5a85a4
Add compact api for rocksdb/cassandra/hbase backend (#1378)
* add compact api for rocksdb/cassandra/hbase backend
* increase and standardize some metrics
* increase metrics for cassandra/hbase and unify display format
* fix codecov missing some files coverage by jacococli
* add ScyllaDBMetrics
* make cassandra compact in the scope of keyspace

Change-Id: I26660b28b64089f3b636020e721659db3466267b
2021-06-11 15:57:20 +08:00
Linary 9f62e6fc4e
Improve check for getting vertex when create edge (#1477)
Change-Id: I86b7ac068154c52faf0d0d7f035cbf08178bf0d8
2021-06-09 17:39:13 +08:00
zhoney 23e3c31a54
Collection optimize for OLTP algorithm and HugeElement (#1409)
* add Eclipse Collection dependency
* use primitive map for properties of HugeElement
* from Map<Id, HugeProperty<?>> to MutableIntObjectMap<HugeProperty<?>>
* allow config oltp collections(JCF or EC)
* add fastutil choice for collection
* change Set<HugeEdge> of HugeVertex to List<HugeEdge>
* use IntObjectMap and IntIntMap to improve shortest path
* improve paths api by remove redundant sourcesAll and targetsAll
* improve paths api performance by using IntObjectHashMap<IntHashSet>
* extract shortestpath and paths record to hold traversed paths
* implement Int2IntsMap for array paths record
* extract Record and Records for paths and shortest path
* adapt primitive collection for kout/kneighbor
* add objectintmapping unit test
* add UT for CollectionFactory and IdSet

Change-Id: I501a18a70054fad3c40bd6b9e852a82a5c185949
2021-06-09 17:36:47 +08:00
coderzc 461948ee26
add user-api test (#1456)
* add user test
* open auth properties
* fix auth startup of memory backend bug
2021-06-01 12:31:01 +08:00
imbajin d48b820a56
refact: unify kout/kneighbor get method with post (#1470) 2021-05-28 15:52:39 +08:00
imbajin 9ef6796dc9
refact: remove source from kneighbor/kout results & unify 'degree ' error info (#1463)
remove source vertex from kout algorithm
unify 'degree ' error info & remove source from kneighbor/kout result
2021-05-27 17:36:11 +08:00
imbajin de81038c21
refact: unify naming of degree for oltp algorithms (#1433)
* refact: remove redundant packaging
* refact: keep compatible with degree in 'step'
* update api version to 0.61
2021-05-12 14:15:05 +08:00
imbajin 727b93c67b
refact: improve error info of edge-update-api (#1443) 2021-05-11 17:27:37 +08:00