o I moved the static parts of the client and server distributions to “src/assembly/resources” and added an assembly that builds the client and server inside the target directory (You need to update the documentation on this)
o The sever is now available at server/target/iotdb-server-0.9.0-SNAPSHOT
o The client is now available at client/target/iotdb-client-0.9.0-SNAPSHOT
o I updated the integration tests to work with these new locations
- I updated the distribution module (binary-distribution) to simply include and unpack the client and server assemblies, which greatly simplifies the assembly itself.
- In the integration-tests you use a process builder to get the current working directory … you can access this in the “user.dir” System property.
- There was a large mixture of artifacts with different versions in the classpath.
o I set all versions to the same using a big dependencyManagement block in the master pom
o I removed the version of every external dependency and moved it into the main dependencyManagement block in the root pom (except dependencies only used in the examples, for these I added a dependencyManagement block in the example pom). This way you instantly identify external dependencies.
o I added an enforcer rule to fail the build if two differing versions of one artifact are being used in the build (This should eliminate this problem from re-occuring)
o I replaced the usage of “${project.version}” with the real version (There is no need to manually update these versions and this way when looking at the pom you instantly know the version … keep in mind if an artifact is deployed to maven central, the user doesn’t have the code and therefore he always has to scroll up to the top in order to see which version is used)
- There were some imports related to Jdk 11 no longer providing some APIs, I moved those imports to a maven profile, which is activated based on the JDK version
- HDFSInputTest created a file in “spark/test/” … if the test failed, the rat plugin would complain the next time it’s run.
I checked the build with all tests on Oracle-Java 8, Open-JDK 11, Oracle-JDK 12.
* remove unbundled dependencies from NOTICE and NOTICE-binary; add License-binary
* move some license declaration from LICENSE to LICENSE-binary
* add NOTICE-binary and LICENSE-binary to the binary tar.gz file
* rename License to LICENSE
* add source code declaration with MavenWrapper
* change the root name as incubating-iotdb-parent
* add DISCLAIMER file
* New Storage Engine. BufferwriteProcessor, OverflowProcessor, FileNodeProcessor and FileNodeManager are replaced by UnsealedTsFileProcessor, UnsealedTsFileProcessor, StorageGroupProcessor and StorageGroupManager.
* Async Flush Processor
* QueryDataSource is modified to adapt the new storage engine.
* Data dir is modified. TsFile.restore, FileNode.restore are discarded.
* a new tsfile summary file: tsfile.resource.
* Overflow file is isomorphic with Tsfile.
* A new chunk structure: TVList
* Each tsfile has a WAL file.
* Add some config parameters: memTableNumber, chunkBufferPoolEnable.
* System_dir is discarded.
* upgrade mvn wrapper version from 3.5.0 to 3.6.0
* replace org.json by alibaba.fastjson
* remove LGPL 2.1 license of logback
* update license and NOTICE
* add CDDL and EDL license
* add comment in PageHeader
* add comment for TsFile, SeriesSchema, RecordUtils
* add pagereader comment
* add SeriesChunkReader comment
* replace SeriesReader by TimeValuePairReader
* add comment for class TsRowGroupBlockMetaData TsDeltaObject RowGroupMetaData
* add comment for QueryConfig, QueryEngine, QueryType
* translate a comment
* format
* change .ts to .tsfile
* add comment for QueryDataSet, OnePassQueryDataSet, Field, OldRowRecord, RowRecord
* recover ReadTest (not completed) and fix a neq filter bug
* update ReadTest
* fix a statistic bug and update ReadTest
* update read demo
* change RowGroupHeader to RowGroupFooter
update ReadTest
* add comment for IteratorOnePassQueryDataSet, TsPrimitiveType
* add comment for IteratorOnePassQueryDataSet, TsPrimitiveType
* add MetaMarker to distinguish RowGroupFooter and ChunkHeader
* fix one SerializedSize bug
add argument 'markerRead' in deserializeFrom()
some refinements
* fix one spelling miss
* add comment for FilterUtils
* to merge add_comment
* add cov plugin and comment for encoding
* update example
* fix all reviews
* fix reviews
* move the project into subfolder
* merge with master, and kill tsfile/interface
* add second level index for tsfile
* modify read process for usage of two level chunkgroup metadata
* code format and rename RowGroup to ChunkGroup, SeriesChunk to Chunk, DeltaObject to Device
* change delta object to device, row group to chunk group
* change deltaFileWriter to fileWriter
* fix ut test (for TsDeviceMetadataTest)
* remove the .travis.yml
* optimize ChunkLoaderImpl (#463)
* add Metadata Seperator
* remove hasNextChunkGroup in TsFileSequenceReader
* add TsFileIOWriterTest
* format
* add reset() for decoder
* delete
* replace InputStream by ByteBuffer in PageDataReader (#467)
* replace InputStream by ByteBuffer in PageDataReader
* remove visitor
* remove visitor in filter
* change Long to long in filter
* test
* remove unnecessary T
* fix issue 479：fix the bug caused by chunk cache loading (#481)
* fix the bug of #479 The number of result is wrong when using filter, which is caused by chunk cache loading
* replace readv2 to read, filterv2 to filter, and MeasurementDescriptor to MeasurementSchema in many classes' import clause. (#480)
* recover example
* change to long
* remove satisfy in SeriesFilter
* patch from write_thanos, for fix bug
* rename reader
* fix review
* change tsfile io output as an interface (#493)
* change tsfile io output as an interface
* add new TsFileIoWriter for incomplete file
* add method
* add flush method to tsfileOutput
* replace TimeValuePair by BatchData (#491)
* read data in batch rather than one by one
* discard TsPrimitive class
* Timegenerator cache value optimization (#496)
optimize time generator and hasNext & next
* Move package (#497)
* Move the read and write packages out of the timeseries package.
* Rename class name *QueryFilter* to *Expression*.
* Move the filter package into the read package.
* Move the expression package out of the filter package.
* Move all exception classes into cn.edu.tsinghua.tsfile.exception.
* Update corresponding import in the IoTDB module.
* Classify the common and utils packages.
* fix the error in iotdb wal package; add processorexception
* on the way
* delete index package
* remove package error
* add utils
* add TimeValuePair, format package
* fix IExpression optimizer bug
* remove fill and groupby package, format package
* format package
* comment old aggregate and query code
* comment read analysis code
* remove overflow update operation package
* add transform filter operator to Expression
* remove useless class in engine/control and fix pacakge in serialize
* qp ok
* QueryProcessExecutor ordinary query ok
* format read
* add series reader
* modify read process
* modify priority reader, merge reader and SealedReader, UnSealedReader
* fix SealedTsFileReader, UnSealedTsFileReader
* update priority merge reader
* remove overflow chunk loader
* delete QueryWithoutFilterExecutorImpl
* format class code
* format code
* modify time generator
* Engine data set without time generator
* engine data set
* replace FileChannel in tsfileSequenceReader as an interface
* remove unused import
* Write thanos (#514)
* fix timegenerator and reader code
* format code and doc
* fix tsfile import
* fix some import
* remove query
* add new class for reading unclosed TsFile
* adapt UnSealedTsFileReader
* update test in qp
* refactor overflow and filenode
* add fill
* resolve the error of filter
* delete generated codes by Thrfit
* fix FileNodeProcessor
* remove read package
* fix test
* delete interval tree test
* resolve all error in filenode
* fix error in tsfile metadata utils
* add jdbc support
* fix error in grafana
* fix error in iotdb src/main/
* fix all error
* modify the test for overflow and filenode
* fix test error
* delete some useless class
* fix test
* fix unit test
* fix test error
* modify the overflow test
* fix test
* delete fill feature
* add IFill again
* open limit and slimit in logical generator
* fix plan test
* format code
* change some TsFileWriter functions as private; add comments in MemSeriesLazeMerger; fix the return value in write() in BufferWriteProcessor
* fix bug when ReadWriteIOUtils.readAsPossible() read too much data. simplize read data by TsFileMetadataUtil in iotdb
* change some parameter type from IMemSeries to TimeValuePairSorter if the parameter is only used for read
* modifty some code for overflow test
* better organize the IMemSeries and RawSeriesChunk (#522)
* delete RawSeriesChunk, and change RawSeriesChunkLazyLoadImpl as ReadOnlyMemChunk
* rename IMemSeries to IWritableMemSeries, and PrimitiveMemSeries to WriableMemChunk
* remove the update and delete insert
* add javadoc of BufferWriteProcessor
* fix bug: add pre flush before write all chunk data into inputstream
* make read program avaliable
* add PriorityMergeReaderTest
* fix the bug caused by querying empty series
* modify the runing mode of test beautiful
* redesign when to generate ChunkGroupFooter (#526)
* fix read test
* fix read bug
* fix bug in read process
* add override for some class
* rename TestUitls to Constant
* fix read test
* fix problems due to alibaba java code
* remove test in IoTDBCompleteTest
* rename queryV2 package to query
* change Action Map from <string, object> to <string, Action>
* remove duplicated code in processor test
* add javadoc for BufferWriteProcessor
* add IoTDB query performance test
* format code, fix bug
* add TsFileDBConfig
* fix too many open files bug of UnSeqFileReader
* fix test
* perfect test
* fix query bug in UnSeqFile logic
* fix test error
* fix integration test error
* submit performance test file, this shoule be deleted later
* add ShowTimeseriesTest2
* perfect integration test
* add MinMaxTime filter
* remove performance package
* add override method for some class
* weaken the function of BufferWriteRestoreManager (#555)
* add file stream manager to avoid too many oopen files error
* add file stream manager for opened files
* fix error in logback.xml configuration
* Make TsFileSequenceReader concurrent safety. (#558)
* add functions in TsFile reader for supporting concurrent reading (thread safe )
* remove commented codes, and prevent logback from outputting its own status at the start of every log
* fix a bug
* Fix unsafed serialized size #486 (#487)
* fix#486 getSerializedSize()
* fix null point
* set reCalculateSerializedSize as private
* Add timing opened file reader manager (#561)
* merge master for clean ByteBuffer on high version JDK ( >1.8)
* BufferWrite: Combine BufferWriteIO with BufferWriterRestoreManager into one class (#566)
* delete SegmentInputStream and WithMMap
* remove directByteBuffer check in TsFile, because we never use it
* remove useless class (#570)
* Replace delta object usage with device (#571)
* remove tsfiledb to iotdb (#575)
* merge with master (remove Chinese in the code)
Zesong Sun
xiangdong huang