* optimize travis to reduce unnecessary test and enhance the readability
* make site available only when use -Pwebsite command
* fix converalls:report command
* use travis official openjkd11 in LinuxOS
* put iotdb-website source code to this repo and use maven to compile it
Co-authored-by: xiangdong huang <sainthxd@gmail.com>
Co-authored-by: SailVR <16231015@bjtu.edu.cn>
* add batch reader interfaces
* modify docs in SeriesReaderWithoutValueFilter
* Add data to TSExecuteStatementResp (#631)
* add fill buffer in EngineDataSetWithoutValueFilter (#646)
* [IOTDB-330] Improve the reading method of unsequence data (#619)
* change UnseqResourceMergeReader to IBatchReader
* Fix bug of "Has not execute query" error when querying (#656)
* Original query process (#653)
* add aggregation reader
* Update SeriesReaderWithoutValueFilter.java
* fix code-coverage stage does not compile service-rpc and some other modules
Co-authored-by: Jackie Tien <JackieTien@foxmail.com>
Co-authored-by: Dawei Liu <atoildw@163.com>
Co-authored-by: Zesong Sun <szs19@mails.tsinghua.edu.cn>
Co-authored-by: Lei Rui <33376433+LeiRui@users.noreply.github.com>
* add metrics service for visualizing query history, query time cost and query plans. The display time is accurate to milliseconds, contributed by @xijunmu (daihui_iot)
* add a framework
* add start-up script of LogVisualizer
* add documentations of log visualizer
* Rephrase document
Change group logic of visualizer
Add sum to statistics
* add request of knowing regular expressions in documents
add comment to the example plan
* add pre set plans
increase usablility
* add result export
* add a command line tool
* support selecting multiple log files
* update docs and examples
o I moved the static parts of the client and server distributions to “src/assembly/resources” and added an assembly that builds the client and server inside the target directory (You need to update the documentation on this)
o The sever is now available at server/target/iotdb-server-0.9.0-SNAPSHOT
o The client is now available at client/target/iotdb-client-0.9.0-SNAPSHOT
o I updated the integration tests to work with these new locations
- I updated the distribution module (binary-distribution) to simply include and unpack the client and server assemblies, which greatly simplifies the assembly itself.
- In the integration-tests you use a process builder to get the current working directory … you can access this in the “user.dir” System property.
- There was a large mixture of artifacts with different versions in the classpath.
o I set all versions to the same using a big dependencyManagement block in the master pom
o I removed the version of every external dependency and moved it into the main dependencyManagement block in the root pom (except dependencies only used in the examples, for these I added a dependencyManagement block in the example pom). This way you instantly identify external dependencies.
o I added an enforcer rule to fail the build if two differing versions of one artifact are being used in the build (This should eliminate this problem from re-occuring)
o I replaced the usage of “${project.version}” with the real version (There is no need to manually update these versions and this way when looking at the pom you instantly know the version … keep in mind if an artifact is deployed to maven central, the user doesn’t have the code and therefore he always has to scroll up to the top in order to see which version is used)
- There were some imports related to Jdk 11 no longer providing some APIs, I moved those imports to a maven profile, which is activated based on the JDK version
- HDFSInputTest created a file in “spark/test/” … if the test failed, the rat plugin would complain the next time it’s run.
I checked the build with all tests on Oracle-Java 8, Open-JDK 11, Oracle-JDK 12.
* remove unbundled dependencies from NOTICE and NOTICE-binary; add License-binary
* move some license declaration from LICENSE to LICENSE-binary
* add NOTICE-binary and LICENSE-binary to the binary tar.gz file
* rename License to LICENSE
* add source code declaration with MavenWrapper
* change the root name as incubating-iotdb-parent
* add DISCLAIMER file
* add logical part for global time filters from partition problem
* Update README.md, doc, dependency version pom, .travis.yml
* modify scala version to 2.11.8 and restrict java version to 8, change scalatest version from 2.12 to 2.1
* upgrade mvn wrapper version from 3.5.0 to 3.6.0
* replace org.json by alibaba.fastjson
* remove LGPL 2.1 license of logback
* update license and NOTICE
* add CDDL and EDL license
* add demo of kafka
* add demo of rocketmq
* add readme of example project
* fix a mistake in IoTDBConnectionParams in jdbc module
* add examples as a module
* add comment in PageHeader
* add comment for TsFile, SeriesSchema, RecordUtils
* add pagereader comment
* add SeriesChunkReader comment
* replace SeriesReader by TimeValuePairReader
* add comment for class TsRowGroupBlockMetaData TsDeltaObject RowGroupMetaData
* add comment for QueryConfig, QueryEngine, QueryType
* translate a comment
* format
* change .ts to .tsfile
* add comment for QueryDataSet, OnePassQueryDataSet, Field, OldRowRecord, RowRecord
* recover ReadTest (not completed) and fix a neq filter bug
* update ReadTest
* fix a statistic bug and update ReadTest
* update read demo
* change RowGroupHeader to RowGroupFooter
update ReadTest
* add comment for IteratorOnePassQueryDataSet, TsPrimitiveType
* add comment for IteratorOnePassQueryDataSet, TsPrimitiveType
* add MetaMarker to distinguish RowGroupFooter and ChunkHeader
* fix one SerializedSize bug
add argument 'markerRead' in deserializeFrom()
some refinements
* fix one spelling miss
* add comment for FilterUtils
* to merge add_comment
* add cov plugin and comment for encoding
* update example
* fix all reviews
* fix reviews
* move the project into subfolder
* merge with master, and kill tsfile/interface
* add second level index for tsfile
* modify read process for usage of two level chunkgroup metadata
* code format and rename RowGroup to ChunkGroup, SeriesChunk to Chunk, DeltaObject to Device
* change delta object to device, row group to chunk group
* change deltaFileWriter to fileWriter
* fix ut test (for TsDeviceMetadataTest)
* remove the .travis.yml
* optimize ChunkLoaderImpl (#463)
* add Metadata Seperator
* remove hasNextChunkGroup in TsFileSequenceReader
* add TsFileIOWriterTest
* format
* add reset() for decoder
* delete
* replace InputStream by ByteBuffer in PageDataReader (#467)
* replace InputStream by ByteBuffer in PageDataReader
* remove visitor
* remove visitor in filter
* change Long to long in filter
* test
* remove unnecessary T
* fix issue 479：fix the bug caused by chunk cache loading (#481)
* fix the bug of #479 The number of result is wrong when using filter, which is caused by chunk cache loading
* replace readv2 to read, filterv2 to filter, and MeasurementDescriptor to MeasurementSchema in many classes' import clause. (#480)
* recover example
* change to long
* remove satisfy in SeriesFilter
* patch from write_thanos, for fix bug
* rename reader
* fix review
* change tsfile io output as an interface (#493)
* change tsfile io output as an interface
* add new TsFileIoWriter for incomplete file
* add method
* add flush method to tsfileOutput
* replace TimeValuePair by BatchData (#491)
* read data in batch rather than one by one
* discard TsPrimitive class
* Timegenerator cache value optimization (#496)
optimize time generator and hasNext & next
* Move package (#497)
* Move the read and write packages out of the timeseries package.
* Rename class name *QueryFilter* to *Expression*.
* Move the filter package into the read package.
* Move the expression package out of the filter package.
* Move all exception classes into cn.edu.tsinghua.tsfile.exception.
* Update corresponding import in the IoTDB module.
* Classify the common and utils packages.
* fix the error in iotdb wal package; add processorexception
* on the way
* delete index package
* remove package error
* add utils
* add TimeValuePair, format package
* fix IExpression optimizer bug
* remove fill and groupby package, format package
* format package
* comment old aggregate and query code
* comment read analysis code
* remove overflow update operation package
* add transform filter operator to Expression
* remove useless class in engine/control and fix pacakge in serialize
* qp ok
* QueryProcessExecutor ordinary query ok
* format read
* add series reader
* modify read process
* modify priority reader, merge reader and SealedReader, UnSealedReader
* fix SealedTsFileReader, UnSealedTsFileReader
* update priority merge reader
* remove overflow chunk loader
* delete QueryWithoutFilterExecutorImpl
* format class code
* format code
* modify time generator
* Engine data set without time generator
* engine data set
* replace FileChannel in tsfileSequenceReader as an interface
* remove unused import
* Write thanos (#514)
* fix timegenerator and reader code
* format code and doc
* fix tsfile import
* fix some import
* remove query
* add new class for reading unclosed TsFile
* adapt UnSealedTsFileReader
* update test in qp
* refactor overflow and filenode
* add fill
* resolve the error of filter
* delete generated codes by Thrfit
* fix FileNodeProcessor
* remove read package
* fix test
* delete interval tree test
* resolve all error in filenode
* fix error in tsfile metadata utils
* add jdbc support
* fix error in grafana
* fix error in iotdb src/main/
* fix all error
* modify the test for overflow and filenode
* fix test error
* delete some useless class
* fix test
* fix unit test
* fix test error
* modify the overflow test
* fix test
* delete fill feature
* add IFill again
* open limit and slimit in logical generator
* fix plan test
* format code
* change some TsFileWriter functions as private; add comments in MemSeriesLazeMerger; fix the return value in write() in BufferWriteProcessor
* fix bug when ReadWriteIOUtils.readAsPossible() read too much data. simplize read data by TsFileMetadataUtil in iotdb
* change some parameter type from IMemSeries to TimeValuePairSorter if the parameter is only used for read
* modifty some code for overflow test
* better organize the IMemSeries and RawSeriesChunk (#522)
* delete RawSeriesChunk, and change RawSeriesChunkLazyLoadImpl as ReadOnlyMemChunk
* rename IMemSeries to IWritableMemSeries, and PrimitiveMemSeries to WriableMemChunk
* remove the update and delete insert
* add javadoc of BufferWriteProcessor
* fix bug: add pre flush before write all chunk data into inputstream
* make read program avaliable
* add PriorityMergeReaderTest
* fix the bug caused by querying empty series
* modify the runing mode of test beautiful
* redesign when to generate ChunkGroupFooter (#526)
* fix read test
* fix read bug
* fix bug in read process
* add override for some class
* rename TestUitls to Constant
* fix read test
* fix problems due to alibaba java code
* remove test in IoTDBCompleteTest
* rename queryV2 package to query
* change Action Map from <string, object> to <string, Action>
* remove duplicated code in processor test
* add javadoc for BufferWriteProcessor
* add IoTDB query performance test
* format code, fix bug
* add TsFileDBConfig
* fix too many open files bug of UnSeqFileReader
* fix test
* perfect test
* fix query bug in UnSeqFile logic
* fix test error
* fix integration test error
* submit performance test file, this shoule be deleted later
* add ShowTimeseriesTest2
* perfect integration test
* add MinMaxTime filter
* remove performance package
* add override method for some class
* weaken the function of BufferWriteRestoreManager (#555)
* add file stream manager to avoid too many oopen files error
* add file stream manager for opened files
* fix error in logback.xml configuration
* Make TsFileSequenceReader concurrent safety. (#558)
* add functions in TsFile reader for supporting concurrent reading (thread safe )
* remove commented codes, and prevent logback from outputting its own status at the start of every log
* fix a bug
* Fix unsafed serialized size #486 (#487)
* fix#486 getSerializedSize()
* fix null point
* set reCalculateSerializedSize as private
* Add timing opened file reader manager (#561)
* merge master for clean ByteBuffer on high version JDK ( >1.8)
* BufferWrite: Combine BufferWriteIO with BufferWriterRestoreManager into one class (#566)
* delete SegmentInputStream and WithMMap
* remove directByteBuffer check in TsFile, because we never use it
* remove useless class (#570)
* Replace delta object usage with device (#571)
* remove tsfiledb to iotdb (#575)
* merge with master (remove Chinese in the code)
* - Added Apache compatible version of the maven wrapper
- Streamlined the maven build to be more align with the way Apache needs projects to be built
* - Fine tuned the build to produce a valid Spring Boot application for the grafana module.
* create iotdb format refactor branch
* make DbFileReader, DbRowGroupReader inheritance relation for TsFile
* Modify bufferwriteprocessor iotdb
* Modify bufferwriteprocessor iotdb
* add RowGroupReader LRUMap
* resolve error code in this two class
* resolve the error code in overflow metadata test case
* Modify bufferwriteprocessor iotdb
* refactor writing process in iotdb
* add cache frameworf for new format
* add LRU in ReaderManager, change the implementation of OverflowValueReader
* fix bug caused by IoTDB format refactor
* add metadata cache framework and tsfilereader utils
* complete the metadata cache
* modify some class in query
* ReaderManager modification
* add RowGroupReader cache
* unit test case occurs error sometimes
* add comment for RecordReaderFactory
* optimize the singleton pattern and add annotation
* add FileMetaData min time, max time filter
* comment RecordReaderFactory queryStructure output
* fix exception log for unsupport aggregation function
* fix bug: merge and produce multiple tsfile; add debug log for cache hint rate
* fix bug in QueryMerger
* delete test
* add log level in OverflowBufferWriteProcessor
* fix a bug : flush start, end flag in LocalFileReader processing logic is wrong
* fix ouputAllValidLog comment in LocalFileReader
* fix bug: multiple device lastupdate time update in asynchrnous
* add volatile to all multiple thread variable
* Solve the map.remove during iterating error in FileNodeProcessor.merge() function
* delete 'temp' in rowgroupblock metadata in bufferwriteprocessor, add static final variable for cache class
* delete system out code
* fix WriteLogNodeTest stream close bug
* add volatile to all variable in filenodeprocessor
Use maven-thrift-plugin to generate thrift classes automatically
Specify the classes generated by antlr
Revert "Use maven-thrift-plugin to generate thrift classes automatically"
This reverts commit db743e601386d56ac6a30e54adf935a2b023a45b.
Xin Wang
xiangdong huang
Dark Templar