mtt_haum/README.md

# Accompanying Analysis Code for the Master Thesis "Analyzing Log Data from Multi-Touch Tables"

The multi-touch table at the Herzog-Anton-Ulrich-Museum (HAUM) in
Braunschweig gives visitors of the Museum the opportunity to interact with
about 70 artworks and 3 virtual cards containing information about the
museum and its layout. The table was installed at the museum in October
2016 and since November 2016 log files from interactions of visitors of the
museum have been collected. The master thesis for which this repository was
created analyzes data collected between December 14, 2016 and July 5, 2023.
In total, the data set consists of 39,767 log files containing 6,700,176
events.

The following gives a short overview over the analyses conducted. All
analysis scripts can be found in the `/code/` folder. The complete folder
structure of this project looks like this (not all folders are committed to
the repository):

```
/<parent_folder>/
|
|- /code/
|- /data/
    |- /haum/
        |- /ContentEyevisit/
        |- /LogFiles/
    |- /metadata/
|- /figures/
|- /results/
|-- README.md
```

## Preprocessing and Descriptives

The first script `01_preprocessing.R` preprocesses the raw log files by
first parsing them so they are readable by standard statistics software
like R or Python and then converting it to event logs. A short R package
doing the preprocessing and more information can be found at
<https://gitea.iwm-tuebingen.de/R/mtt>.

The second script `02_descriptives.R` calculates some descriptive
statistics and creates plots to get an overall feeling for the data set.

## Conformance Checking

A normative Petri net to test the data quality after the preprocessing is
created in `03_create-petrinet.py` and the actual data quality check is
done in `04_conformance-checking.py`. Both scripts are written in Python
using the pm4py library. For more information and the full documentation go
to <https://pm4py.fit.fraunhofer.de/>.

The next script `05_check-traces.R` (written in R again) checks the corrupt
trace found during conformance checking and exports the cleaned data sets
used for the following analyses.

## Clustering of Items

To answer the first research question in the thesis "Do interaction
patterns look different for different artworks? (Control-flow perspective)"
process mining was applied to all paths separately for each item on the
multi-touch table. Fitness, precision, generalizability, simplicity,
soundness, number of connecting arcs, number of transitions, number of
places, number of different variants, and the most frequent variant were
obtained and saved to a CSV file (Python script `06_infos-items.py`). These
information were then read into R in the next script
(`07_item-clustering.R`) and used (together with other features) for
hierarchical clustering.

## Clustering of Cases

For the second research question "What kind of patterns exist and are there
typical user behaviors? (Case perspective)" six indicator variables for
five proposed user navigation types were calculated in
`08_case-characteristics.R` and then used for hierarchical clustering und
recursive partitioning to extract the different navigation types in script
`09_user-navigation.R`. A validation of the results for data from 2018 was
done in `10_validation.R`. Different variants for the cases for the
complete data set and the data used for investigating the navigation types
(all log files from 2019) was done in `11_investigate-variants.R` and the
found clusters of the navigation types were further investigated with
process mining techniques in R (`12_dfgs-case-clusters.R`) and Python
(`13_pm-case-clusters.py`).

# Software versions

## R

The following gives the output of `sessionInfo()` with all relevant
packages attached.

```
R version 4.3.3 (2024-02-29 ucrt)
Platform: x86_64-w64-mingw32/x64 (64-bit)
Running under: Windows 10 x64 (build 19045)

Matrix products: default


locale:
[1] LC_COLLATE=German_Germany.utf8 
[2] LC_CTYPE=German_Germany.utf8   
[3] LC_MONETARY=German_Germany.utf8
[4] LC_NUMERIC=C                   
[5] LC_TIME=German_Germany.utf8    

time zone: Europe/Berlin
tzcode source: internal

attached base packages:
[1] grid      stats     graphics  grDevices utils    
[6] datasets  methods   base     

other attached packages:
 [1] igraph_2.0.3      DiagrammeR_1.0.11 partykit_1.2-20  
 [4] mvtnorm_1.2-4     libcoin_1.0-10    rpart_4.1.23     
 [7] rgl_1.3.1         smacof_2.1-6      e1071_1.7-14     
[10] colorspace_2.1-0  plotrix_3.8-4     vioplot_0.4.0    
[13] zoo_1.8-12        sm_2.2-6.0        cluster_2.1.6    
[16] factoextra_1.0.7  ggplot2_3.5.0     dplyr_1.1.4      
[19] pbapply_1.7-2     petrinetR_0.3.0   processmapR_0.5.3
[22] eventdataR_0.3.1  edeaR_0.9.4       bupaR_0.5.4      
[25] lattice_0.22-6    devtools_2.4.5    usethis_2.2.3    
[28] mtt_0.0-1        

loaded via a namespace (and not attached):
  [1] RColorBrewer_1.1-3 rstudioapi_0.16.0 
  [3] jsonlite_1.8.8     shape_1.4.6.1     
  [5] magrittr_2.0.3     jomo_2.7-6        
  [7] nloptr_2.0.3       rmarkdown_2.26    
  [9] fs_1.6.3           vctrs_0.6.5       
 [11] heplots_1.6.2      memoise_2.0.1     
 [13] minqa_1.2.6        base64enc_0.1-3   
 [15] htmltools_0.5.8.1  forcats_1.0.0     
 [17] polynom_1.4-1      weights_1.0.4     
 [19] broom_1.0.5        Formula_1.2-5     
 [21] mitml_0.4-5        htmlwidgets_1.6.4 
 [23] plotly_4.10.4      lubridate_1.9.3   
 [25] cachem_1.0.8       mime_0.12         
 [27] lifecycle_1.0.4    iterators_1.0.14  
 [29] pkgconfig_2.0.3    Matrix_1.6-5      
 [31] R6_2.5.1           fastmap_1.1.1     
 [33] shiny_1.8.1.1      digest_0.6.35     
 [35] shinyTime_1.0.3    pkgload_1.3.4     
 [37] ellipse_0.5.0      Hmisc_5.1-2       
 [39] fansi_1.0.6        timechange_0.3.0  
 [41] nnls_1.5           gdata_3.0.0       
 [43] abind_1.4-5        httr_1.4.7        
 [45] compiler_4.3.3     proxy_0.4-27      
 [47] remotes_2.5.0      withr_3.0.0       
 [49] doParallel_1.0.17  htmlTable_2.4.2   
 [51] backports_1.4.1    carData_3.0-5     
 [53] pkgbuild_1.4.4     pan_1.9           
 [55] MASS_7.3-60.0.1    sessioninfo_1.2.2 
 [57] gtools_3.9.5       tools_4.3.3       
 [59] foreign_0.8-86     httpuv_1.6.15     
 [61] nnet_7.3-19        glue_1.7.0        
 [63] inum_1.0-5         nlme_3.1-164      
 [65] promises_1.3.0     checkmate_2.3.1   
 [67] generics_0.1.3     gtable_0.3.4      
 [69] class_7.3-22       tidyr_1.3.1       
 [71] data.table_1.15.4  hms_1.1.3         
 [73] car_3.1-2          xml2_1.3.6        
 [75] utf8_1.2.4         ggrepel_0.9.5     
 [77] foreach_1.5.2      pillar_1.9.0      
 [79] stringr_1.5.1      later_1.3.2       
 [81] splines_4.3.3      survival_3.5-8    
 [83] tidyselect_1.2.1   miniUI_0.1.1.1    
 [85] knitr_1.46         gridExtra_2.3     
 [87] xfun_0.43          visNetwork_2.1.2  
 [89] stringi_1.8.3      lazyeval_0.2.2    
 [91] boot_1.3-30        evaluate_0.23     
 [93] codetools_0.2-20   wordcloud_2.6     
 [95] tibble_3.2.1       cli_3.6.2         
 [97] xtable_1.8-4       munsell_0.5.1     
 [99] candisc_0.8-6      Rcpp_1.0.12       
[101] parallel_4.3.3     ellipsis_0.3.2    
[103] profvis_0.3.8      urlchecker_1.0.1  
[105] lme4_1.1-35.3      glmnet_4.1-8      
[107] viridisLite_0.4.2  ggthemes_5.1.0    
[109] scales_1.3.0       purrr_1.0.2       
[111] rlang_1.1.3        mice_3.16.0       
```


## Python

The Python version used is `Python 3.12.0`. The following gives the output
of `pip list` for the virtual environment all analyses have been run in.

```
Package           Version
----------------- ------------
asttokens         2.4.1
colorama          0.4.6
contourpy         1.2.0
cycler            0.12.1
decorator         5.1.1
deprecation       2.1.0
executing         2.0.1
fonttools         4.46.0
graphviz          0.20.1
intervaltree      3.1.0
ipython           8.18.1
jedi              0.19.1
joblib            1.3.2
kiwisolver        1.4.5
lxml              4.9.3
matplotlib        3.8.2
matplotlib-inline 0.1.6
networkx          3.2.1
numpy             1.26.2
packaging         23.2
pandas            2.1.3
parso             0.8.3
Pillow            10.1.0
pip               24.0
pm4py             2.7.8.4
prompt-toolkit    3.0.41
PuLP              2.8.0
pure-eval         0.2.2
pydotplus         2.0.2
Pygments          2.17.2
pyparsing         3.1.1
python-dateutil   2.8.2
pytz              2023.3.post1
scikit-learn      1.4.0
scipy             1.11.4
six               1.16.0
sortedcontainers  2.4.0
stack-data        0.6.3
StringDist        1.0.9
threadpoolctl     3.2.0
tqdm              4.66.1
traitlets         5.14.0
tzdata            2023.3
wcwidth           0.2.12
```