Commit Graph

1482 Commits

Author SHA1 Message Date
nhussain d89101b95f add missing test 2020-06-19 11:44:41 -04:00
chenzomi c268c88220 aware quantization training auto create graph 2020-06-19 22:01:16 +08:00
baihuawei 862522376f add reduce and softmax_cross_entropy_with_logits 2020-06-19 21:37:43 +08:00
ougongchang 939cd29d7e Add a callback named SummaryCollector and delete SummaryStep callback
I added a SummaryCollector to help users automatically collect information
such as the network, loss, learning rate and so on, making it easier to collect this information.

It also can collect train lineage and eval lineage information which is
collected by TrainLineage Callback and EvalLineage Callback in
MindInsight.

I also add some UT for SummaryCollect to keep the code correct.
2020-06-19 21:07:55 +08:00
mindspore-ci-bot 21c67eddd5 !1897 save print data to file
Merge pull request !1897 from jinyaohui/print
2020-06-19 17:50:34 +08:00
yanghaitao 9f336bb735 fix TextFileDataset and CLUEDataset failed with to_device 2020-06-19 17:28:05 +08:00
jinyaohui ac23a179bf save print data to file 2020-06-19 17:25:22 +08:00
wilfChen 480bf4151b Gpu Minimum & Maximum kernels support int32 2020-06-19 17:11:04 +08:00
mindspore-ci-bot 182215e060 !2284 Add Pass to Eliminate Redundant Depend
Merge pull request !2284 from BowenK/fix_depend
2020-06-19 16:39:55 +08:00
mindspore-ci-bot b6ff27245f !1990 fix profiling stream id
Merge pull request !1990 from caifubi/fix-profiling-stream-id
2020-06-19 16:36:34 +08:00
mindspore-ci-bot 66e07efccd !2315 add Pack op for aicpu when axis=-1
Merge pull request !2315 from yanzhenxiang2020/add_pack_open
2020-06-19 16:30:14 +08:00
mindspore-ci-bot 2d6d3cc86b !2339 support catch IndexError in C++
Merge pull request !2339 from zhangbuxue/support_catch_index_error_in_c++
2020-06-19 15:28:18 +08:00
mindspore-ci-bot 8867c67d61 !1935 Summary callback as collector for summary and lineage
Merge pull request !1935 from 李鸿章/policy_writer
2020-06-19 14:53:14 +08:00
BowenK 8f29e7242f add pass to eliminate depend value 2020-06-19 14:52:52 +08:00
mindspore-ci-bot 230963d08e !2332 Fix ConfusionSoftmaxGrad fusion pass work if the ReduceSum's attr of keep_dims set with False
Merge pull request !2332 from huanghui/fix-ConfusionSoftmaxGrad-fusion-pass
2020-06-19 14:44:23 +08:00
caifubi a49c6f0b13 Fix profiling stream id bug 2020-06-19 14:34:20 +08:00
mindspore-ci-bot 9958bc479a !2161 [qat]Export network from quantization aware network to deploy
Merge pull request !2161 from vlne-v1/I1IZV3-quant-infer
2020-06-19 14:16:00 +08:00
mindspore-ci-bot 06b511ca94 !2301 add sparse proximal ada grad optimizer
Merge pull request !2301 from lilei/sparse_proximal_ada_grad
2020-06-19 14:07:50 +08:00
Li Hongzhang 0921c1e538 enhance the SummaryRecord with set_mode and add_value 2020-06-19 13:03:00 +08:00
buxue 2c9ca199ad support catch IndexError in C++ 2020-06-19 12:13:18 +08:00
huanghui c7bda5363d fix ConfusionSoftmaxGrad fusion pass work if the ReduceSum's attr of keep_dims set False 2020-06-19 10:37:15 +08:00
yanzhenxiang2020 8621c032d9 add pack op for aicpu 2020-06-19 10:30:11 +08:00
Wei Luning 1d77bf86a9 Exports MindSpore quant predict model to deploy with GEIR 2020-06-19 10:21:35 +08:00
lilei 497067d7b2 add sparse proximal ada grad optimizer 2020-06-19 09:56:28 +08:00
mindspore-ci-bot 1424178601 !1663 change lenet and alexnet dir
Merge pull request !1663 from wukesong/change_network_path
2020-06-19 09:45:19 +08:00
mindspore-ci-bot b7b4333d13 !2272 remove dataset send from data exec
Merge pull request !2272 from wangnan39/remove_dataset_send_from_model_init
2020-06-19 09:33:12 +08:00
mindspore-ci-bot a9d06edae9 !2282 remove _quant_op.py from __init__.py
Merge pull request !2282 from chenzhongming/master
2020-06-19 09:20:03 +08:00
peilinwang 1e36b0649f remove graphengine changes
remove graphengine changes

concat op

Truncate Pair

concat_op

remove graph engine changes

ToNumberOp implementation almost done

ToNumberOp complete

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

ci fix

merge conflicts
2020-06-18 20:07:35 -04:00
hesham 11826fb256 DuplicateOp 2020-06-18 19:47:27 -04:00
mindspore-ci-bot 90bb9320aa !2314 Implemented RandomHorizontalFlipWithBBox and BoundingBoxAugment C++ Ops
Merge pull request !2314 from imaaamin/object_ops_pr
2020-06-19 07:08:42 +08:00
mindspore-ci-bot a83baafbf6 !2253 Add ConcatOp to Dataset
Merge pull request !2253 from nhussain/concat_op
2020-06-19 06:32:15 +08:00
mindspore-ci-bot 3784220056 !2317 rework on dataset.text.vocab to support any user special_tokens
Merge pull request !2317 from ZiruiWu/vocab_rework
2020-06-19 05:25:31 +08:00
nhussain 5515016dba remove graphengine changes
remove graphengine changes

concat op

Truncate Pair

concat_op

remove graph engine changes
2020-06-18 17:17:50 -04:00
mindspore-ci-bot ffc8a3c362 !2274 add PadEndOp
Merge pull request !2274 from xunxue/padend
2020-06-19 05:05:14 +08:00
mindspore-ci-bot e4322baece !2316 [Dataset] Move python tree transformation into cpp pass
Merge pull request !2316 from JunhanHu/alter_node_cpp
2020-06-19 05:02:03 +08:00
islam_amin 0af156d169 added two ops for object detection, random horizontal flip with bbox and bouding box augment. along with their unit tests 2020-06-18 16:55:31 -04:00
xunxue 87aa9c8f7a PadEndOp 2020-06-18 16:07:34 -04:00
Junhan Hu 57f3732ac3 Move python tree transformation into cpp pass. 2020-06-18 15:52:38 -04:00
Zirui Wu b6e9504b31 phase I of Vocab rework
phase II vocab rework

added more test cases

fix api doc string

address review cmts and fix CI

address ci complains

fix review cmts

ci
2020-06-18 15:36:28 -04:00
Zirui Wu 8f2674850b address API doc style and content
addr review cmts

revert

ci

private class

ci

fix ci

address ci

address review cmts

fix style err
2020-06-18 12:23:42 -04:00
wangnan39@huawei.com 887838d452 do not send the data during the model init 2020-06-18 22:18:41 +08:00
mindspore-ci-bot c0fe8c0322 !2273 [AutoParallel]update EmbeddingLookUp op
Merge pull request !2273 from lichen/fix_embeding_look_up
2020-06-18 21:07:52 +08:00
mindspore-ci-bot 5850b99161 !2211 Add TruncatePair Op to dataset
Merge pull request !2211 from h.farahat/pair_truncate
2020-06-18 20:58:40 +08:00
wukesong 7dfd369998 modify lenet&alexnet dir 2020-06-18 20:45:46 +08:00
mindspore-ci-bot fce37a5fbe !2281 add Sigmoid and SigmoidGrad operation of GPU
Merge pull request !2281 from zyli2020/add_sigmoid
2020-06-18 20:09:02 +08:00
lichenever 563622874a update 2020-06-18 19:45:40 +08:00
chenzomi bbce6faff9 remove _quant_ops.py from __init__.py 2020-06-18 19:26:22 +08:00
mindspore-ci-bot d0c5071cab !1993 [Dataset] Fix codedex.
Merge pull request !1993 from luoyang/pylint
2020-06-18 18:59:31 +08:00
mindspore-ci-bot 2ecd5bdf25 !2239 [MD] convert csv to mindrecord
Merge pull request !2239 from liyong126/csv_to_mindrecord
2020-06-18 18:56:33 +08:00
mindspore-ci-bot d9b8da14e2 !2275 [Auto parallel] Changing bprob of EmbeddingLookup
Merge pull request !2275 from Xiaoda/4-fix-the-embeddinglookup-errors
2020-06-18 18:08:19 +08:00
mindspore-ci-bot 2e002ab64c !2292 gpu fix all nop node graph execute
Merge pull request !2292 from limingqi107/master
2020-06-18 17:17:06 +08:00
mindspore-ci-bot 9b90d89f6b !2276 fix eliminate get ref parameter
Merge pull request !2276 from fary86/fix_eliminate_get_ref
2020-06-18 17:14:26 +08:00
fary86 15b3fba0ef Fix eliminate get ref parameter 2020-06-18 16:10:53 +08:00
Xiaoda Zhang 69574f3823 fix the bprob error of embeddinglookup 2020-06-18 16:06:56 +08:00
limingqi107 0f4397cece fix all nop node graph execute 2020-06-18 15:56:38 +08:00
lizhenyu ea0cd5ccdd add Sigmoid and SigmoidGrad operation of GPU 2020-06-18 15:42:58 +08:00
mindspore-ci-bot 74c3e15675 !2194 fix FakeQuantPerLayer/FakeQuantPerLayerGrad symmetric=True calculation error bug
Merge pull request !2194 from 王东旭/master
2020-06-18 15:19:10 +08:00
mindspore-ci-bot 3559cb5ccd !2252 dataset: repair bug in config load
Merge pull request !2252 from ms_yan/config_load
2020-06-18 15:03:44 +08:00
mindspore-ci-bot 90e05579c8 !2197 Change acc threshold of test_resnet_imagenet
Merge pull request !2197 from zhaoting/ResNet50_st
2020-06-18 14:53:00 +08:00
mindspore-ci-bot 60f4795f40 !2220 fix binary dump and add test case
Merge pull request !2220 from leopz/fix_dump
2020-06-18 14:30:52 +08:00
mindspore-ci-bot 1e12b07afd !2251 Add implementation of SparseApplyProximalAdagrad cpu kernel
Merge pull request !2251 from YuJianfeng/proximal
2020-06-18 14:15:02 +08:00
zhaoting c083089e7e change acc threshold of test_resnet_imagenet 2020-06-18 14:13:22 +08:00
ms_yan 8d1dae46ac Throw error when load config failed 2020-06-18 13:47:32 +08:00
liyong 7369950a93 convert csv to mindrecord 2020-06-18 12:55:22 +08:00
mindspore-ci-bot 19e66f06e2 !2150 Gpu Tanh kernel support fp16
Merge pull request !2150 from chenweifeng/tanh-fp16
2020-06-18 12:50:25 +08:00
mindspore-ci-bot 0c3d96a98b !2236 Refactor the callback module in an encapsulated way
Merge pull request !2236 from 李鸿章/callback
2020-06-18 12:09:19 +08:00
yujianfeng c3871d98cc Add implementation of SparseApplyProximalAdagrad cpu kernel 2020-06-18 11:43:27 +08:00
hesham b9495a9ccc Truncate Pair 2020-06-17 23:11:27 -04:00
mindspore-ci-bot 9ba6f61d01 !2148 fix hook and bprop debug issue in pynative
Merge pull request !2148 from wangqiuliang/fix-hook-bprop-issue
2020-06-18 10:44:45 +08:00
mindspore-ci-bot 4e3b3711be !2199 Fix the condition when activation name is 0
Merge pull request !2199 from Simson/push-to-opensource
2020-06-18 10:42:18 +08:00
leopz a67132f6b7 fix shape and add testcase 2020-06-18 10:36:32 +08:00
mindspore-ci-bot 294449697a !2179 Add sort by index for each group of AllReduce
Merge pull request !2179 from YuJianfeng/all_reduce_index
2020-06-18 10:35:48 +08:00
mindspore-ci-bot f513bb8f83 !2163 [Auto parallel] Move 'EmbeddingLookup' to internal
Merge pull request !2163 from Xiaoda/3-changing-embeddinglookup-internal
2020-06-18 10:05:55 +08:00
kingfo 358982a98f fix hook and bprop debug issue 2020-06-18 09:50:30 +08:00
mindspore-ci-bot fe797aaf10 !2229 add ftrl optimizer
Merge pull request !2229 from zyli2020/add_ftrl_op
2020-06-18 09:48:42 +08:00
mindspore-ci-bot 95d887a35b !2226 add adam op for wide&deep model
Merge pull request !2226 from zyli2020/add_adam_op
2020-06-18 09:47:51 +08:00
mindspore-ci-bot c4863683ef !2235 add SigmoidCrossEntropyWithLogitsGrad operation
Merge pull request !2235 from zyli2020/add_sigmoid_cross_entropy_with_logits_grad
2020-06-18 09:47:15 +08:00
mindspore-ci-bot 116ed509bf !2234 add SigmoidCrossEntropyWithLogits op
Merge pull request !2234 from zyli2020/add_sigmoid_cross_entropy_with_logits
2020-06-18 09:46:28 +08:00
yujianfeng f15cb6b7c9 Add sort by index for each group of AllReduce 2020-06-18 09:18:01 +08:00
simson ca988e9e69 fix the condition when activation name is 0 2020-06-18 09:14:45 +08:00
mindspore-ci-bot a4048e192c !2256 Rename Sampler::Reset() to Sampler::ResetSampler()
Merge pull request !2256 from JesseKLee/sampler
2020-06-18 03:33:53 +08:00
mindspore-ci-bot ea829e89c3 !2198 Add MaskOp to dataset
Merge pull request !2198 from h.farahat/mask_op
2020-06-18 02:50:16 +08:00
Jesse Lee dcfdff6021 Rename Sampler Reset 2020-06-17 14:43:45 -04:00
mindspore-ci-bot 808380a9f9 !2142 Cleanup dataset UT: refactor visualize()
Merge pull request !2142 from Tinazhang/reorg-visualize
2020-06-18 01:30:36 +08:00
ms_yan fdafc690f8 repair problem in NumpySlicesDataset 2020-06-17 21:49:02 +08:00
mindspore-ci-bot 2865436fee !2092 Tokenizers
Merge pull request !2092 from qianlong21st/june_third
2020-06-17 21:40:32 +08:00
Tinazhang 169eaf73c7 reorganize util function visualize() 2020-06-17 09:30:05 -04:00
lizhenyu 636b8e2b88 add SigmoidCrossEntropyWithLogitsGrad op 2020-06-17 19:33:27 +08:00
panfengfeng c745b6bd9d 回退 'Pull Request !2189 : dataset: repair some bug in NumpySlicesDataset' 2020-06-17 19:26:36 +08:00
mindspore-ci-bot 4642df207a !2210 gpu optimize the max device memory config
Merge pull request !2210 from limingqi107/max_device_memory_optimize
2020-06-17 19:20:27 +08:00
mindspore-ci-bot 11a256536d !2189 dataset: repair some bug in NumpySlicesDataset
Merge pull request !2189 from ms_yan/numpy_slice_repair
2020-06-17 19:17:08 +08:00
mindspore-ci-bot 4b5cbe5d4a !2186 Optimization for opt
Merge pull request !2186 from Kang/opt
2020-06-17 17:29:38 +08:00
lizhenyu 694a8213b7 add adam optimizer 2020-06-17 17:07:41 +08:00
Li Hongzhang ecc459158e callback module in encapsulated 2020-06-17 17:01:44 +08:00
mindspore-ci-bot 65f2212fd3 !2215 Support hccl profiling
Merge pull request !2215 from caifubi/support-hccl-profiling
2020-06-17 17:01:10 +08:00
lizhenyu ac2217dbae add SigmoidCrossEntropyWithLogits op 2020-06-17 17:00:26 +08:00
lizhenyu c3360a84cd add ftrl optimizer 2020-06-17 16:58:00 +08:00
mindspore-ci-bot b9ad407dc2 !2204 add check for tensor slice before convert to ops
Merge pull request !2204 from zhangbuxue/add_check_for_tensor_slice_before_convert_to_ops
2020-06-17 16:39:11 +08:00
mindspore-ci-bot cef901fe0d !2069 Fix input value check for Momentum, SparseApplyFtrl and SparseApplyAdagrad.
Merge pull request !2069 from liuxiao/fix-input-value-check-for-SparseApplyFtrl-and-SparseApplyAdaGrad
2020-06-17 16:37:18 +08:00
wilfChen 9201ea5ed2 replace tanh implement with cudnn 2020-06-17 16:35:27 +08:00