init commit

This commit is contained in:
whystar 2020-09-23 12:13:07 +08:00
commit 8c4666d3bd
7 changed files with 2772 additions and 0 deletions

14
.gitignore vendored Normal file
View File

@ -0,0 +1,14 @@
./code/candidate_dups
README\.html
*.pyc
code/candidate_dups/
code/\.DS_Store
\.DS_Store
code/manual_verify_ui\.py
code/verify_history\.txt

21
LICENSE Normal file
View File

@ -0,0 +1,21 @@
MIT License
Copyright (c) 2017 StarLee
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.

1754
dup_prs.md Normal file

File diff suppressed because it is too large Load Diff

870
pullreq_info/pullreq.sql Normal file

File diff suppressed because one or more lines are too long

15
pullreq_info/readme.md Normal file
View File

@ -0,0 +1,15 @@
### English description of the fields in ``pullreq.sql``
- `repo_slug`: The slug of the project (`user_name/repository_name`), which can compose the homepage URL of the project with a heading string `https://github.com/`.
- `pr_num`: The tracking number of the pull request.
- `pr_info`: A Json object obtained via GitHub API, which contains the basic information of the pull request. The commonly used attributes can be directly parsed from this object, *e.g.*, one can get the pull request title by calling `json_obj["title"]`. More information demanded in specific context can be requested from the hyperlink value of the corresponding field, *e.g.*,
one can get the review comments of a pull request from `json[review_comments_url]`.
### 文件``pullreq.sql``中字段的中文描述:
- `repo_slug`: pull request所属项目的标识`用户名/仓库名`)。
- `pr_num`: pull request在项目追踪系统中的编号。
- `pr_info`: 这是使用GitHub API采集获得的json对象包含了pull request的基本信息。一些常用的信息可以直接从该对象解析例如pull request 的标题可以通过`json_obj["title"]`获取。其它的信息需求可以通过字段所对应的链接进行二次采集,例如可以通过`json[review_comments_url]`获取pull request的审查评论。

50
readme.md Normal file
View File

@ -0,0 +1,50 @@
[中文](readme_zh.md)
## The *DupPR* dataset
### About this dataset
This dataset includes a list of ***accidentally duplicate*** pull requests collected from GitHub, which can be seen in [dup_prs.md](dup_prs.md). The readily-avaialbe information of these pull requests can be found in [pullreq_info](pullreq_info).
### How can I help?
You would be appreciated if you can open an issue/pull-request to
- add new duplicates you have found
- point out the errors in the dataset
Attention: please do not submit duplicate issue/pull-request :)
### How can I cite this work?
```
@inproceedings{yu2018dataset,
title={A dataset of duplicate pull-requests in github},
author={Yu, Yue and Li, Zhixing and Yin, Gang and Wang, Tao and Wang, Huaimin},
booktitle={Proceedings of the 15th International Conference on Mining Software Repositories},
pages={22--25},
year={2018}
}
```
### Papers using this dataset
- Li, Z., Yu, Y., Zhou, M., Wang, T., Yin, G., Lan, L, & Wang, H.Redundancy, Context, and Preference: An Empirical Study of Duplicate Pull Requests in OSS Projects. (2020). *IEEE Transactions on Software Engineering* (TSE). [PDF]()
- Wang, Q., Xu, B., Xia, X., Wang, T., & Li, S. (2019, October). Duplicate Pull Request Detection: When Time Matters. In *Proceedings of the 11th Asia-Pacific Symposium on Internetware* (pp. 1-10).
- Zhou, S., Vasilescu, B., & Kästner, C. (2019, August). What the fork: a study of inefficient and efficient forking practices in social coding. In *Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering* (ESEC/FSE) (pp. 350-361).
- Ren, L., Zhou, S., Kästner, C., & Wąsowski, A. (2019, February). Identifying redundancies in fork-based development. In *Proceedings 2019 IEEE 26th International Conference on Software Analysis, Evolution and Reengineering* (SANER) (pp. 230-241). IEEE.
- Li, Z., Yu, Y., Wang, T., Yin, G., Mao, X., & Wang, H. (2019). Detecting Duplicate Contributions in Pull-based Model Combining Textual and Change Similarities. *Journal of Computer Science and Technology*. [PDF]()
- Li, Z., Yin, G., Yu, Y., Wang, T., & Wang, H. (2017, September). Detecting duplicate pull-requests in github. In *Proceedings of the 9th Asia-Pacific Symposium on Internetware* (pp. 1-6). [PDF]()

48
readme_zh.md Normal file
View File

@ -0,0 +1,48 @@
[English](readme.md)
## *DupPR* 数据集
### 关于数据集
本数据集包含了开发者在GitHub平台上 ***非故意提交*** 的重复Pull-request具体数据参见[dup_prs.md](dup_prs.md).
### 帮助我们
非常欢迎大家帮助我们一起完善此数据集你可以通过提交Issue或者Pull-request来
- 添加你新发现的重复pull-request
- 指出此数据集中所包含的错误数据
注意: 请不要提交重复issue/pull-request :)
### 引用此数据集
```
@inproceedings{yu2018dataset,
title={A dataset of duplicate pull-requests in github},
author={Yu, Yue and Li, Zhixing and Yin, Gang and Wang, Tao and Wang, Huaimin},
booktitle={Proceedings of the 15th International Conference on Mining Software Repositories},
pages={22--25},
year={2018}
}
```
### 使用了此数据集的研究
- Li, Z., Yu, Y., Zhou, M., Wang, T., Yin, G., Lan, L, & Wang, H.Redundancy, Context, and Preference: An Empirical Study of Duplicate Pull Requests in OSS Projects. (2020). *IEEE Transactions on Software Engineering* (TSE)
- Wang, Q., Xu, B., Xia, X., Wang, T., & Li, S. (2019, October). Duplicate Pull Request Detection: When Time Matters. In *Proceedings of the 11th Asia-Pacific Symposium on Internetware* (pp. 1-10).
- Zhou, S., Vasilescu, B., & Kästner, C. (2019, August). What the fork: a study of inefficient and efficient forking practices in social coding. In *Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering* (ESEC/FSE) (pp. 350-361).
- Ren, L., Zhou, S., Kästner, C., & Wąsowski, A. (2019, February). Identifying redundancies in fork-based development. In *Proceedings 2019 IEEE 26th International Conference on Software Analysis, Evolution and Reengineering* (SANER) (pp. 230-241). IEEE.
- Li, Z., Yu, Y., Wang, T., Yin, G., Mao, X., & Wang, H. (2019). Detecting Duplicate Contributions in Pull-based Model Combining Textual and Change Similarities. *Journal of Computer Science and Technology*.
- Li, Z., Yin, G., Yu, Y., Wang, T., & Wang, H. (2017, September). Detecting duplicate pull-requests in github. In *Proceedings of the 9th Asia-Pacific Symposium on Internetware* (pp. 1-6).