Commit Graph

528 Commits

Author SHA1 Message Date
Xiangdong Huang 2c03bb4890 ASF Header: remove the rest '2019 Apache IoTDB(incubating)...' (#30) 2019-01-25 09:54:22 +08:00
xiangdong huang c7c5ac2d35 fix conflict when merging PR 4 2019-01-21 19:35:33 +08:00
Xiangdong Huang 5a11aaebaa
Merge pull request #4 from apache/fix_license
modify ASF header for each file and add related maven plugin
2019-01-21 19:30:01 +08:00
Christofer Dutz a4d1bc98e3 - Added an exclusion to the license check plugin as on Jenkins we stage SNAPSHOTS inside a local directory. 2019-01-21 10:25:49 +01:00
xiangdong huang 8d61c44156 skip check header for local-snapshots-dir and gitignore it 2019-01-21 15:09:58 +08:00
xiangdong huang a1e096c668 set max memory as 1024MB for UTs (maven-surefire-plugin) 2019-01-21 14:59:03 +08:00
xiangdong huang 3a6e7195f3 merge with master 2019-01-21 14:58:23 +08:00
xiangdong huang f7b9c64f70 add ASF header on *.md files 2019-01-20 09:11:42 +08:00
xiangdong huang 691ffe4a35 1. modify asf header for each file; 2. enable apache-rat-plugin; 3. add more exclusive files on apache-rat-plugin and license-maven-plugin, i.e., *.json, *.md, and *.csv 2019-01-19 18:52:35 +08:00
Christofer Dutz 33d5a2179d - Added the configuration for SonarQube analysis on build.apache.org/analysis
- Added Jenkinsfile and jenkins.pom for ASF build automation
2019-01-18 15:36:50 +01:00
Rui Liu 93727d8e34 Check style and license-format (#590)
* format Almost for obeying Google Java Style.

* fix the problem of checkstyle

* fix license-format template file location
2019-01-18 01:31:48 +08:00
Xiangdong Huang 1da230749c delete unused plugin (#584) 2019-01-15 17:15:11 +08:00
XuYi bce8d49923
fix format bug (#580) 2019-01-13 22:33:47 +08:00
XuYi d6934c1efd add apache header check plugin and format code plugin (#572)
* add apache header check plugin

* add fotmat plugin

* move format code to verify phase

* change to compile phase

* change to verify phase

* remove special char in .travis

* remove useless code

* add apach header and format codes

* Update MavenWrapperDownloader.java
2019-01-13 15:59:52 +08:00
Xiangdong Huang 2dd4727df1 rename package name from cn.edu.tsinghua to org.apache.iotdb (#578) 2019-01-12 13:45:02 +08:00
Xiangdong Huang 22fe7d3172
IT IS TIME TO KILL THANOS. (#577)
* add comment in PageHeader

* add comment for TsFile, SeriesSchema, RecordUtils

* add pagereader comment

* add SeriesChunkReader comment

* replace SeriesReader by TimeValuePairReader

* add comment for class TsRowGroupBlockMetaData TsDeltaObject RowGroupMetaData

* add comment for QueryConfig, QueryEngine, QueryType

* translate a comment

* format

* change .ts to .tsfile

* add comment for QueryDataSet, OnePassQueryDataSet, Field, OldRowRecord, RowRecord

* recover ReadTest (not completed) and fix a neq filter bug

* update ReadTest

* fix a statistic bug and update ReadTest

* update read demo

* change RowGroupHeader to RowGroupFooter
update ReadTest

* add comment for IteratorOnePassQueryDataSet, TsPrimitiveType

* add comment for IteratorOnePassQueryDataSet, TsPrimitiveType

* add MetaMarker to distinguish RowGroupFooter and ChunkHeader

* fix one SerializedSize bug
add argument 'markerRead' in deserializeFrom()
some refinements

* fix one spelling miss

* add comment for FilterUtils

* to merge add_comment

* add cov plugin and comment for encoding

* update example

* fix all reviews

* fix reviews

* move the project into subfolder

* merge with master, and kill tsfile/interface

* add second level index for tsfile

* modify read process for usage of two level chunkgroup metadata

* code format and rename RowGroup to ChunkGroup, SeriesChunk to Chunk, DeltaObject to Device

* change delta object to device, row group to chunk group

* change deltaFileWriter to fileWriter

* fix ut test (for TsDeviceMetadataTest)

* remove the .travis.yml

* optimize ChunkLoaderImpl (#463)

* add Metadata Seperator

* remove hasNextChunkGroup in TsFileSequenceReader

* add TsFileIOWriterTest

* format

* add reset() for decoder

* delete

* replace InputStream by ByteBuffer in PageDataReader (#467)

* replace InputStream by ByteBuffer in PageDataReader

* remove visitor

* remove visitor in filter

* change Long to long in filter

* test

* remove unnecessary T

* fix issue 479:fix the bug caused by chunk cache loading (#481)

* fix the bug of #479  The number of result is wrong when using filter, which is caused by chunk cache loading

* replace readv2 to read, filterv2 to filter, and MeasurementDescriptor to MeasurementSchema in many classes' import clause. (#480)

* recover example

* change to long

* remove satisfy in SeriesFilter

* patch from write_thanos, for fix bug

* rename reader

* fix review

* change tsfile io output as an interface (#493)

* change tsfile io output as an interface

* add new TsFileIoWriter for incomplete file

* add  method

* add flush method to tsfileOutput

* replace TimeValuePair by BatchData (#491)

* read data in batch rather than one by one
* discard TsPrimitive class

* Timegenerator cache value optimization (#496)

optimize time generator and hasNext & next

* Move package (#497)

* Move the read and write packages out of the timeseries package.

* Rename class name *QueryFilter* to *Expression*.

* Move the filter package into the read package.

* Move the expression package out of the filter package.

* Move all exception classes into cn.edu.tsinghua.tsfile.exception.

* Update corresponding import in the IoTDB module.

* Classify the common and utils packages.

* fix the error in iotdb wal package; add processorexception

* on the way

* delete index package

* remove package error

* add utils

* add TimeValuePair, format package

* fix IExpression optimizer bug

* remove fill and groupby package, format package

* format package

* comment old aggregate and query code

* comment read analysis code

* remove overflow update operation package

* add transform filter operator to Expression

* remove useless class in engine/control and fix pacakge in serialize

* qp ok

* QueryProcessExecutor ordinary query ok

* format read

* add series reader

* modify read process

* modify priority reader, merge reader and SealedReader, UnSealedReader

* fix SealedTsFileReader, UnSealedTsFileReader

* update priority merge reader

* remove overflow chunk loader

* delete QueryWithoutFilterExecutorImpl

* format class code

* format code

* modify time generator

* Engine data set without time generator

* engine data set

* replace FileChannel in tsfileSequenceReader  as an interface

* remove unused import

* Write thanos (#514)

* fix timegenerator and reader code

* format code and doc

* fix tsfile import

* fix some import

* remove query

* add new class for reading unclosed TsFile

* adapt UnSealedTsFileReader

* update test in qp

* refactor overflow and filenode

* add fill

* resolve the error of filter

* delete generated codes by Thrfit

* fix FileNodeProcessor

* remove read package

* fix test

* delete interval tree test

* resolve all error in filenode

* fix error in tsfile metadata utils

* add jdbc support

* fix error in grafana

* fix error in iotdb src/main/

* fix all error

* modify the test for overflow and filenode

* fix test error

* delete some useless class

* fix test

* fix unit test

* fix test error

* modify the overflow test

* fix test

* delete fill feature

* add IFill again

* open limit and slimit in logical generator

* fix plan test

* format code

* change some TsFileWriter functions as private; add comments in MemSeriesLazeMerger; fix the return value in write() in BufferWriteProcessor

* fix bug when ReadWriteIOUtils.readAsPossible() read too much data. simplize read data by TsFileMetadataUtil in iotdb

* change some parameter type from IMemSeries to TimeValuePairSorter if the parameter is only used for read

* modifty some code for overflow test

* better organize the IMemSeries and RawSeriesChunk (#522)

* delete RawSeriesChunk, and change RawSeriesChunkLazyLoadImpl as ReadOnlyMemChunk

* rename IMemSeries to IWritableMemSeries, and PrimitiveMemSeries to WriableMemChunk

* remove the update and delete insert

* add javadoc of BufferWriteProcessor

* fix bug: add pre flush before write all chunk data into inputstream

* make read program avaliable

* add PriorityMergeReaderTest

* fix the bug caused by querying empty series

* modify the runing mode of test beautiful

* redesign when to generate ChunkGroupFooter (#526)

* fix read test

* fix read bug

* fix bug in read process

* add override for some class

* rename TestUitls to Constant

* fix read test

* fix problems due to alibaba java code

* remove test in IoTDBCompleteTest

* rename queryV2 package to query

* change Action Map from <string, object> to <string, Action>

* remove duplicated code in processor test

* add javadoc for BufferWriteProcessor

* add IoTDB query performance test

* format code, fix bug

* add TsFileDBConfig

* fix too many open files bug of UnSeqFileReader

* fix test

* perfect test

* fix query bug in UnSeqFile logic

* fix test error

* fix integration test error

* submit performance test file, this shoule be deleted later

* add ShowTimeseriesTest2

* perfect integration test

* add MinMaxTime filter

* remove performance package

* add override method for some class

* weaken the function of BufferWriteRestoreManager (#555)

* add file stream manager to avoid too many oopen files error

* add file stream manager for opened files

* fix error in logback.xml configuration

* Make TsFileSequenceReader concurrent safety. (#558)

* add functions in TsFile reader for supporting concurrent reading (thread safe )

* remove commented codes, and prevent logback from outputting its own status at the start of every log

* fix a bug

* Fix unsafed serialized size #486 (#487)

* fix #486 getSerializedSize()

* fix null point

* set reCalculateSerializedSize as private

* Add timing opened file reader manager (#561)

* merge master for clean ByteBuffer on high version JDK ( >1.8)

* BufferWrite: Combine BufferWriteIO with BufferWriterRestoreManager into one class (#566)

* delete SegmentInputStream and WithMMap

* remove directByteBuffer check in TsFile, because we never use it

* remove useless class (#570)

* Replace delta object usage with device (#571)

* remove tsfiledb to iotdb (#575)

* merge with master (remove Chinese in the code)
2019-01-12 00:37:14 +08:00
XuYi 219effbe15
replace antlr3 maven plugin with antlr-runtime (#565) 2019-01-09 13:56:48 +08:00
XuYi 634b461cc6 remove joda and use default date/time class in java (#557)
* remove joda and use default date/time class in java

* Update DatetimeUtilsTest.java

* add help command in cli
2019-01-04 20:28:01 +08:00
XuYi d99fafc6c9
support jdk11 (#556) 2019-01-03 16:53:01 +08:00
Jiaye Wu ead93ac907 Remove plugin duplicates & lower case IoTDB in artifactId of POM (#535)
* Remove plugin duplicates in POM to avoid warnings
2018-12-22 21:54:45 +08:00
Xiangdong Huang 65dce4f54a
delete generated codes by Thrift (#517)
* delete generated codes by Thrfit

* Update pom.xml
2018-12-14 15:40:03 +08:00
Christofer Dutz 2ddfa9171f Working on streamlining the Maven build (#510)
* - Added Apache compatible version of the maven wrapper
- Streamlined the maven build to be more align with the way Apache needs projects to be built

* - Fine tuned the build to produce a valid Spring Boot application for the grafana module.
2018-12-14 14:31:54 +08:00
XuYi b1acc3a2eb
Fix issue 464 (#465) 2018-11-29 18:50:43 +08:00
XuYi 0879817907
mv service rpc (#453) 2018-11-26 11:16:25 +08:00
XuYi 688e5ff96d
fix issue 454 and 455 (#456) 2018-11-20 20:08:04 +08:00
XuYi 439996194e
add skip test config (#459) 2018-11-20 19:49:26 +08:00
Xiangdong Huang 167f733e8e Assemble all related projects into one. (#450) 2018-11-19 11:31:03 +08:00
Kun Liu 48f7a83ad3
mvn: remove duplicate maven plugin (#447)
* remove duplicate maven plugin

* add build status
2018-11-13 17:07:23 +08:00
XuYi 4bcb960831
add code cov plugin (#443) 2018-10-25 21:52:30 +08:00
qiaojialingithub 8241a365bb update 0.8.0-SNAPSHOT 2018-09-05 10:28:03 +08:00
qiaojialin 8ab01d9fc2 v0.7.0 (#408) 2018-06-05 11:50:16 +08:00
qiaojialingithub 4a8ab0e57d v0.6.0 2018-05-06 17:35:25 +08:00
XuYi 0e77dc0ea2
change to 0.5.0 and remove derby in pom (#361) 2018-04-03 12:01:30 +08:00
XuYi f0f22fc334
Unseq overflow impl (#329) 2018-03-13 21:58:47 +08:00
jt2594838 8445b08cd8 Write memory control (#196) 2017-12-30 02:41:17 +08:00
XuYi 54089f9064
F index pr (#216)
* add index framework, kvindex and JUnit test
2017-12-20 11:14:18 +08:00
XuYi 0c039b88db
Revert "add index framework, kvindex, JUnit test and Performance test (#145)" (#215)
This reverts commit 8482f7a961.
2017-12-19 15:05:47 +08:00
kr11 8482f7a961 add index framework, kvindex, JUnit test and Performance test (#145) 2017-12-19 14:51:33 +08:00
xingtanzjr 86d9e486e6 upgrade to 0.3.1 (#171)
* upgrade to 0.3.1
2017-12-08 15:45:16 +08:00
jixuan1989 77e7e3f912
upgrade to 0.3.0 (#157) 2017-12-01 04:38:56 +08:00
liukun 83fe593cec
Iotdb format refactor (#133)
* create iotdb format refactor branch

* make DbFileReader, DbRowGroupReader inheritance relation for TsFile

* Modify bufferwriteprocessor iotdb

* Modify bufferwriteprocessor iotdb

* add RowGroupReader LRUMap

* resolve error code in this two class

* resolve the error code in overflow metadata test case

* Modify bufferwriteprocessor iotdb

* refactor writing process in iotdb

* add cache frameworf for new format

* add LRU in ReaderManager, change the implementation of OverflowValueReader

* fix bug caused by IoTDB format refactor

* add metadata cache framework and tsfilereader utils

* complete the metadata cache

* modify some class in query

* ReaderManager modification

* add RowGroupReader cache

* unit test case occurs error sometimes

* add comment for RecordReaderFactory

* optimize the singleton pattern and add annotation

* add FileMetaData min time, max time filter

* comment RecordReaderFactory queryStructure output

* fix exception log for unsupport aggregation function

* fix bug: merge and produce multiple tsfile; add debug log for cache hint rate

* fix bug in QueryMerger

* delete test

* add log level in OverflowBufferWriteProcessor

* fix a bug : flush start, end flag in LocalFileReader processing logic is wrong

* fix ouputAllValidLog comment in LocalFileReader

* fix bug: multiple device lastupdate time update in asynchrnous

* add volatile to all multiple thread variable

* Solve the map.remove during iterating error in FileNodeProcessor.merge() function

* delete 'temp' in rowgroupblock metadata in bufferwriteprocessor, add static final variable for cache class

* delete system out code

* fix WriteLogNodeTest stream close bug

* add volatile to all variable in filenodeprocessor
2017-11-30 17:59:31 +08:00
XuYi 38735432a1
change tsfiledb to iotdb in script (#143)
change tsfiledb to iotdb in script
2017-11-29 22:17:52 +08:00
qiaojialingithub 33b80e5ccf 0.2.0-SNAPSHOT 2017-11-03 17:14:07 +08:00
xiangdong huang a6b852cc1f fit version and local CI 2017-11-02 20:53:58 +08:00
xiangdong huang 113a8877d8 update version 2017-10-15 16:46:39 +08:00
qiaojialingithub 42cf70baec change groupid 2017-09-08 21:55:05 +08:00
qiaojialingithub 8cd03b8632 update thrift related 2017-09-08 20:38:56 +08:00
qiaojialingithub ca1d23e517 remove jdbc 2017-09-08 14:35:31 +08:00
qiaojialingithub 9b5f433e18 update master 2017-09-01 11:05:49 +08:00
qiaojialingithub b4b4d72542 change thrift operationtype to string 2017-09-01 11:01:37 +08:00
doge 713bcba9e4 !138 将可执行文件夹tsfiledb改名为iotdb
Merge pull request !138 from doge/fix_issue_IESWN
2017-08-31 15:42:55 +08:00
qiaojialingithub 66b1416144 add aggregation name in result show 2017-08-31 11:30:55 +08:00
liukun06 f971a4769f change import 2017-08-23 16:16:00 +08:00
Jiaye Wu 82f6eb57ec
Try to support Eclipse
Revert "Specify the classes generated by antlr"

This reverts commit 60b941f7072212a485e64a7db1d2370edd9868b5.
2017-08-03 15:07:08 +08:00
Jiaye Wu 30b3d233c5
Use antlr3-maven-plugin to generate lexer/parser automatically
Use maven-thrift-plugin to generate thrift classes automatically

Specify the classes generated by antlr

Revert "Use maven-thrift-plugin to generate thrift classes automatically"

This reverts commit db743e601386d56ac6a30e54adf935a2b023a45b.
2017-08-03 15:07:03 +08:00
Dark Templar 67349dac3c remote common io 2017-07-21 14:20:21 +08:00
Dark Templar a8f110ce91 fix a bug for load data command 2017-07-17 10:34:53 +08:00
Dark Templar 92992c1581 add auto insert sql 2017-07-16 15:37:30 +08:00
Dark Templar 6023ded832 fix a bug for log 2017-07-11 15:51:37 +08:00
Dark Templar e68f2b82d4 dix antlr3.4 and 2.7.7 confict 2017-07-10 15:43:19 +08:00
Dark Templar 9c77659212 fix jconsole windows bug 2017-07-10 14:45:30 +08:00
Dark Templar 260340305d fix many bugs 2017-07-08 17:46:30 +08:00
XuYi ba6b74a5fe merge from master 2017-07-04 19:49:41 +08:00
XuYi b143db7f3c optimize client 2017-07-04 19:46:50 +08:00
Dark Templar 78b94bee30 change logical plan time transfer init 2017-07-04 00:46:58 +08:00
xingtanzjr c7c4dfa5c3 xx 2017-05-24 11:54:30 +08:00
xingtanzjr 19bc54d3cd fuck 2017-05-22 20:56:32 +08:00
BigGreyBear d322a93c40 no more import error 2017-05-22 17:46:49 +08:00
xingtanzjr 887a72f3ff add sh 2017-05-17 15:29:37 +08:00
qiaojialingithub d885928c08 modify start shell 2017-05-15 09:45:57 +08:00
qiaojialingithub 250ed54fc6 prepare to merge origin 2017-05-15 08:45:47 +08:00
xingtanzjr 2f9a71bb93 fix a bug in ValueReader 2017-05-12 09:30:31 +08:00
liukun 70213dfb4d add dependency for antlr 2017-05-10 19:42:28 +08:00
xingtanzjr b2f187e010 add Service JDBC 2017-05-10 18:24:19 +08:00
xingtanzjr 2357155022 add QP 2017-05-10 18:14:40 +08:00
XuYi 301085374b add auth jdbc and server code 2017-05-10 18:11:50 +08:00
XuYi 909df230d9 add overflow metadata test 2017-05-07 16:52:34 +08:00
xingtanzjr a3a5a392e3 Transfer codes from pre-project 2017-05-07 14:50:07 +08:00