pisco_log
banner

A B C D E F G H I J K L M N O P Q R S T U V W X Y Z All

Geological and Mining Engineering

Geological and Mining Engineering (GME), published by Scineer Publishing PTE. LTD, is an open-access journal. GME is devoted to publish geological and mining engineering related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on geological and mining engineering throughout the world. GME welcomes all original

ISSN: 3029-1887(P)
3029-2034(O)

View Journal Current Issue Register

Food Safety and Quality


Food Safety and Quality (FSQ), published by Scineer Publishing PTE. LTD, is an open-access journal. FSQ is devoted to publish food safety and quality related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on food safety and quality throughout the world. FSQ welcomes all original manuscripts that do not be published in any other journals.

ISSN: 3029-2115(P)
3029-2123(O)

View Journal Current Issue Register

Hydraulic Engineering and Power Research

Hydraulic Engineering and Power Research (HEPR), published by Scineer Publishing PTE. LTD, is an open-access journal. HEPR is devoted to publish hydraulic engineering and power related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on hydraulic engineering and power throughout the world. HEPR welcomes all original manuscripts that do not be published in any other journals.Â

  Â
    ISSN: 3029-2158(P)
         3029-2166(O)

      Â

View Journal Current Issue Register

Medical and Health Research

Medical and Health Research (MHR), published by Scineer Publishing PTE. LTD, is an open-access journal. MHR is devoted to publish medicine related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on medicine throughout the world. MHR welcomes all original manuscripts that do not be published in any other journals.Â

  Â
    ISSN: 3029-2190(P)
         3029-2204(O)

      Â

View Journal Current Issue Register

Practical Medical Research

Practical Medical Research (PMR), published by Scineer Publishing PTE. LTD, is an open-access journal. PMR is devoted to publish medicine related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on medicine throughout the world. PMR welcomes all original manuscripts that do not be published in any other journals.Â


   Â
    ISSN: 3029-2085(P)
          3029-2093(O)

      Â

View Journal Current Issue Register

Forum on Research and Innovation Management

Forum on Research and Innovation Management (FRIM), published by Scineer Publishing PTE. LTD, is an open-access journal. FRIM is devoted to publish research and innovation management related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on research and innovation management throughout the world. FRIM welcomes all original manuscripts that do not be published in any other journals.Â

   Â
    ISSN: 3029-1933(P)
         3029-1984(O)

      Â

View Journal Current Issue Register

Construction Safety Technology and Management

Construction Safety Technology and Management (CSTM), published by Scineer Publishing PTE. LTD, is an open-access journal. CSTM is devoted to publish construction safety technology and management related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on construction safety technology and management throughout the world. CSTM welcomes all original manuscripts that do not be published in any other journals.Â

  Â
     ISSN: 3029-2069(P)
           3029-2077(O)

      Â

View Journal Current Issue Register

Industrial Technology Research

Industrial Technology Research (ITR), published by Scineer Publishing PTE. LTD, is an open-access journal. ITR is devoted to publish industrial technology related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on industrial technology throughout the world. ITR welcomes all original manuscripts that do not be published in any other journals.

   Â
    ISSN: 3029-1895(P)
          3029-2026(O)

      Â

View Journal Current Issue Register

Environmental Protection and Health

Environmental Protection and Health (EPH), published by Scineer Publishing PTE. LTD, is an open-access journal. EPH is devoted to publish environmental protection and health related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on environmental protection and health throughout the world. EPH welcomes all original manuscripts that do not be published in any other journals.Â

 Â
    ISSN: 3029-1909(P)
         3029-2018(O)

      Â

View Journal Current Issue Register

Artificial Intelligence Technology Research

Artificial Intelligence Technology Research (AITR), published by Scineer Publishing PTE. LTD, is an open-access journal. AITR is devoted to publish artificial intelligence technology related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on artificial intelligence technology throughout the world. AITR welcomes all original manuscripts that do not be published in any other journals.Â

    ISSN: 3029-1968(O)
         3029-195X(P)
    Â
 Â

View Journal Current Issue Register

Curriculum Learning and Exploration

Curriculum Learning and Exploration (CLE), published by Scineer Publishing PTE. LTD, is an open-access journal. CLE is devoted to publish curriculum related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on curriculum throughout the world. CLE welcomes all original manuscripts that do not be published in any other journals.Â

    ISSN: 3029-1976(O)
         3029-1941(P)
      Â

View Journal Current Issue Register

Evaluation of Educational Research

Evaluation of Educational Research (EER), published by Scineer Publishing PTE. LTD, is an open-access journal. EER is devoted to publish education related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on education throughout the world. EER welcomes all original manuscripts that do not be published in any other journals.

    ISSN: 3029-1992(O)
         3029-1925(P)
      Â

View Journal Current Issue Register

World Education Forum

World Education Forum (WEF), published by Scineer Publishing PTE. LTD, is an open-access journal. WEF is devoted to publish education related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on education throughout the world. WEF welcomes all original manuscripts that do not be published in any other journals.

    ISSN: 3029-214X(O)
         3029-2131(P)

      Â

View Journal Current Issue Register

New Explorations in Education and Teaching

New Explorations in Education and Teaching (NEET), published by Scineer Publishing PTE. LTD, is an open-access journal. NEET is devoted to publish education related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on education throughout the world. NEET welcomes all original manuscripts that do not be published in any other journals.Â

    ISSN: 3029-200X(O)
         3029-1917(P)

      Â

View Journal Current Issue Register

Modern Economic Management Forum

Â

Modern Economic Management Forum (MEMF), published by Scineer Publishing PTE. LTD, is an open-access journal. MEMF is devoted to publish modern economic management related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on economic management throughout the world. MEMF welcomes all original manuscripts that do not be published in any other journals.Â
    ISSN: 3029-2182(O)
         3029-2174(P)

      Â

View Journal Current Issue Register

Research and Commentary on Humanities and Arts

Research and Commentary on Humanities and Arts (RCHA), published by Scineer Publishing PTE. LTD, is an open-access journal. RCHA is devoted to publish humanities and arts related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on humanities and arts throughout the world. RCHA welcomes all original manuscripts that do not be published in any other journals.Â

Â

  Â
      ISSN: 3029-2050(O)
           3029-2042(P)

      Â

View Journal Current Issue Register

An Improved Apriori Algorithm Based on the Spark Platform

Congshuai Xia, Gang Fang, Wenqiang Gao, Qian Zhao

Abstract


Apriori algorithm is one of the most classical algorithms used to mine frequent term sets, but because of the need to scan the
calculation method of transaction set repeatedly, the computational efficiency of the algorithm is seriously reduced and it is difficult to parallelize processing. With the advent of the era of big data, the data scale is increasing. In order to solve this problem, this paper proposes a
Apriori parallelization processing method based on vertical data format and Spark computing framework — GC-Apriori algorithm. Using
the vertical data format, reduce the duplication between things, improve the efficiency of data storage, and the efficiency of frequent item
set mining. At the same time, the broadcast variable mechanism of Spark is used to improve the overall computing efficiency. Comparing
the performance with other distributed Apriori algorithms on the same scale, the computational efficiency of GC-Apriori algorithm is improved. The results show that the algorithm effectively improves the efficiency of frequent term set mining of Apriori algorithm in distributed environment.

Keywords


Apriori algorithm; Spark; Vertical data format

Full Text:

PDF

Included Database


References


[1] Ye Yanbin, Chiang C C.A parallel Apriori algorithm for frequent itemsets mining[C]//Proc of International Conference on Software Engineering Research, Management and Applications.Washington DC:IEEE Computer Society, 2006:87-94.

[2] Qiu Hongjian, GuRong, Yuan Chunfeng, et al.YAFIM:a parallel frequent itemset mining algorithm with Spark [C]//Proc of IEEE International ParallelDistributed Processing Symposium Workshops Washington DC:IEEE Computer Society, 2014:1664-1671.

[3] Su Weisong. Evaluation of the memory overhead of a typical memory computing system [D]. Southeast University, 2016.

[4] Wu Lei. Research on the frequent pattern mining algorithm in the big data environment [D]. Guangdong University of Technology,

2019.

[5] Xing Changzheng, An Weiguo, Wang Xing. Improvement of frequent itemset algorithm for vertical data format mining[J]. Computer

Engineering and Science, 2017, 39(7):1365-1370.

[6] Zheng Jingyi, Deng Xiaoheng. Distributed frequent term set mining algorithm based on item coding [J]. Computer Application Research, 2019, 36 (4): 1059-1067.




DOI: http://dx.doi.org/10.18686/aitr.v2i3.4406

Refbacks