Francesca Freuli | Università degli Studi di Padova (original) (raw)

Uploads

Papers by Francesca Freuli

Research paper thumbnail of Replication success under questionable research practices – a simulation study

Increasing evidence suggests that the reproducibility and replicability of scientific findings is... more Increasing evidence suggests that the reproducibility and replicability of scientific findings is threatened by researchers employing questionable research practices (QRP) in order to achieve publishable, positive and significant results. Numerous metrics have been developed to determine replication success but it has not yet been established how well those metrics performin the presence of QRPs. This paper aims to compare the performance of different metrics quantifying replication success in the presence of four different types of QRPs: cherry picking, questionable interim analyses, questionable inclusion of covariates, and questionable subgroup analyses. Our results show that the metric based on the golden sceptical p -value does better in maintaining low values of overall type-I error rate, but often needs larger replication sample sizes, especially when severe QRPs are employed.

Research paper thumbnail of Contextual Consistency as an Improvement to User Experience and System Transparency: The Case of a Vibrotactile Relaxation Device with Implicit Triggers

Symbiotic Interaction, 2018

In mobile devices for travellers and tourists, haptic stimulation is mainly employed to provide d... more In mobile devices for travellers and tourists, haptic stimulation is mainly employed to provide directions and alerts; but it could also be employed to influence the user’s affective experience. Here we consider providing relaxing stimulation via a symbiotic vibrotactile vest and compare implicit triggers that are or not contextually consistent. We meet participants in the city center and walk them to a Point of Interest. During the walk, the vibrotactile vest provides them with relaxing stimulation either during waits (consistent condition) or while they walk (inconsistent condition). Participants, who are unaware of the trigger rationale, found the contextually consistent stimulation more pleasant, tended to consider it more transparent and useful. The results suggest that contextualized implicit triggers not only improve the user experience, but could also represent an intuitive strategy to increase the transparency of symbiotic systems.

Research paper thumbnail of Reducing Elevated Gravitational-Force Events through visual feedback: a simulator study

Transportation Research Procedia, 2021

Abstract Road traffic accidents represent one of the leading causes of death across all age group... more Abstract Road traffic accidents represent one of the leading causes of death across all age groups globally. Most of these accidents can be directly attributed to drivers’ failure to select the correct driving speed. Thus, actions aimed to mitigate inappropriate driving performance, including speeding, are needed. Here, we used a dynamic driving simulator to investigate the effects of different real-time coaching programs on driving performance, specifically on the occurrence of Elevated Gravitational-Force Events (EGFEs). Forty-three drivers underwent a two-day evaluation. On the first day, participants –after an initial screening and depending on their driving style– were divided into two groups: defensive vs. aggressive drivers. On the second day, they received a different type of real time visual feedback based on their driving performance. For each of the two driving style groups, half of the drivers received contingent positive feedback (when smooth driving events occurred), the other half received contingent negative feedback (when harsh driving events occurred). Thus, there were four groups based on driving style and feedback. Overall, results showed that among aggressive drivers contingent feedback –independently from its type– reduces the occurrence of EGFEs. Potential applications of the proposed methodology include its use for Pay-how-you-drive programs aimed to improve driver speed control.

Research paper thumbnail of Visual Feedback Effectiveness in Reducing Over Speeding of Moped-Riders

Frontiers in Psychology, 2021

The use of assistance systems aimed at reducing road fatalities is spreading, especially for car ... more The use of assistance systems aimed at reducing road fatalities is spreading, especially for car drivers, but less effort has been devoted to developing and testing similar systems for powered two-wheelers (PTWs). Considering that over speeding represents one of the main causal factors in road crashes and that riders are more vulnerable than drivers, in the present study we investigated the effectiveness of an assistance system which signaled speed limit violations during a simulated moped-driving task, in optimal and poor visibility conditions. Participants performed four conditions of simulated riding: one baseline condition without Feedback, one Fog condition in which visual feedback was provided so as to indicate to the participants when a speed limit (lower than that indicated by the traffic signals) was exceeded, and two post-Feedback conditions with and without Fog, respectively, in which no feedback was delivered. Results showed that participants make fewer speeding violatio...

Research paper thumbnail of Transparency Heuristic: Effect of Implicitness of Online Data Acquisition on Sensitivity Perception

We present a study that investigates whether the transparency of the data acquisition technique c... more We present a study that investigates whether the transparency of the data acquisition technique can work as a heuristic when making evaluations about data protection and sensitivity. The study (N = 40) compares an explicit data acquisition technique (questionnaires) with an implicit one (eye-tracker) and varies also the actual sensitivity of the data collected (popularity evaluation vs. usability evaluation). The results suggest that, when judging general data sensitivity, the transparency of the data collection procedure might work as a heuristic; instead if more specific judgments or decisions are asked this effect is not observed. Implications are discussed.

Research paper thumbnail of A State Space Approach to Dynamic Modeling of Mouse-Tracking Data

Frontiers in Psychology, 2019

Mouse-tracking recording techniques are becoming very attractive in experimental psychology. They... more Mouse-tracking recording techniques are becoming very attractive in experimental psychology. They provide an effective means of enhancing the measurement of some real-time cognitive processes involved in categorization, decision-making, and lexical decision tasks. Mouse-tracking data are commonly analysed using a two-step procedure which first summarizes individuals' hand trajectories with independent measures, and then applies standard statistical models on them. However, this approach can be problematic in many cases. In particular, it does not provide a direct way to capitalize the richness of hand movement variability within a consistent and unified representation. In this article we present a novel, unified framework for mouse-tracking data. Unlike standard approaches to mouse-tracking, our proposal uses stochastic state-space modeling to represent the observed trajectories in terms of both individual movement dynamics and experimental variables. The model is estimated via a Metropolis-Hastings algorithm coupled with a non-linear recursive filter. The characteristics and potentials of the proposed approach are illustrated using a lexical decision case study. The results highlighted how dynamic modeling of mouse-tracking data can considerably improve the analysis of mouse-tracking tasks and the conclusions researchers can draw from them.

Research paper thumbnail of Cross-cultural perspective of driving style in young adults: Psychometric evaluation through the analysis of the Multidimensional Driving Style Inventory

Transportation Research Part F: Traffic Psychology and Behaviour, 2020

Abstract Self-evaluating methods are frequently used to identify driving styles. Among others, on... more Abstract Self-evaluating methods are frequently used to identify driving styles. Among others, one of the most commonly used questionnaires is the Multidimensional Driving Style Inventory (MDSI), developed for the Israeli population. Because of the extensive use of the questionnaire, the present paper aims to validate an Italian version and to confirm the 8-factor structure of the original one, i.e, dissociative, anxious, risky, angry, high-velocity, distress-reduction, patient, and careful driving style. The Italian version of the MDSI was filled out by 561 Italian drivers, who had a driving license for at least 1 year. A confirmatory factorial analysis (CFA) was conducted on the 44-item of the translated questionnaire showing not so good values of the goodness of fit tests (SRMR = 0.085; RMSEA = 0.063). The total-item correlation of each scale indicated that 4 items had a low index of total-item correlation. A second CFA was conducted on the remaining 40 items: goodness fit parameters improved (SRMR = 0.0685, RMSEA = 0.0584). Previous validations of the original version of MDSI for different populations (Argentine, Romanian, Chinese, Malaysian, Butch and Belgian) showed several critical issues in confirming the original structure. In the Italian version of MDSI validated in the present paper, the original 8-factor structure was confirmed by removing the 4 items which did not properly contribute to the factors. The results not only confirmed the usefulness of the MDSI in assessing driving style but they also indicated that the concept of driving style is considered in the same way in Italy and Israel, even though traffic rules are different. The latter consideration raises interesting questions for future research concerning cross-cultural comparisons of driving behavior in different countries.

Research paper thumbnail of Replication success under questionable research practices – a simulation study

Increasing evidence suggests that the reproducibility and replicability of scientific findings is... more Increasing evidence suggests that the reproducibility and replicability of scientific findings is threatened by researchers employing questionable research practices (QRP) in order to achieve publishable, positive and significant results. Numerous metrics have been developed to determine replication success but it has not yet been established how well those metrics performin the presence of QRPs. This paper aims to compare the performance of different metrics quantifying replication success in the presence of four different types of QRPs: cherry picking, questionable interim analyses, questionable inclusion of covariates, and questionable subgroup analyses. Our results show that the metric based on the golden sceptical p -value does better in maintaining low values of overall type-I error rate, but often needs larger replication sample sizes, especially when severe QRPs are employed.

Research paper thumbnail of Contextual Consistency as an Improvement to User Experience and System Transparency: The Case of a Vibrotactile Relaxation Device with Implicit Triggers

Symbiotic Interaction, 2018

In mobile devices for travellers and tourists, haptic stimulation is mainly employed to provide d... more In mobile devices for travellers and tourists, haptic stimulation is mainly employed to provide directions and alerts; but it could also be employed to influence the user’s affective experience. Here we consider providing relaxing stimulation via a symbiotic vibrotactile vest and compare implicit triggers that are or not contextually consistent. We meet participants in the city center and walk them to a Point of Interest. During the walk, the vibrotactile vest provides them with relaxing stimulation either during waits (consistent condition) or while they walk (inconsistent condition). Participants, who are unaware of the trigger rationale, found the contextually consistent stimulation more pleasant, tended to consider it more transparent and useful. The results suggest that contextualized implicit triggers not only improve the user experience, but could also represent an intuitive strategy to increase the transparency of symbiotic systems.

Research paper thumbnail of Reducing Elevated Gravitational-Force Events through visual feedback: a simulator study

Transportation Research Procedia, 2021

Abstract Road traffic accidents represent one of the leading causes of death across all age group... more Abstract Road traffic accidents represent one of the leading causes of death across all age groups globally. Most of these accidents can be directly attributed to drivers’ failure to select the correct driving speed. Thus, actions aimed to mitigate inappropriate driving performance, including speeding, are needed. Here, we used a dynamic driving simulator to investigate the effects of different real-time coaching programs on driving performance, specifically on the occurrence of Elevated Gravitational-Force Events (EGFEs). Forty-three drivers underwent a two-day evaluation. On the first day, participants –after an initial screening and depending on their driving style– were divided into two groups: defensive vs. aggressive drivers. On the second day, they received a different type of real time visual feedback based on their driving performance. For each of the two driving style groups, half of the drivers received contingent positive feedback (when smooth driving events occurred), the other half received contingent negative feedback (when harsh driving events occurred). Thus, there were four groups based on driving style and feedback. Overall, results showed that among aggressive drivers contingent feedback –independently from its type– reduces the occurrence of EGFEs. Potential applications of the proposed methodology include its use for Pay-how-you-drive programs aimed to improve driver speed control.

Research paper thumbnail of Visual Feedback Effectiveness in Reducing Over Speeding of Moped-Riders

Frontiers in Psychology, 2021

The use of assistance systems aimed at reducing road fatalities is spreading, especially for car ... more The use of assistance systems aimed at reducing road fatalities is spreading, especially for car drivers, but less effort has been devoted to developing and testing similar systems for powered two-wheelers (PTWs). Considering that over speeding represents one of the main causal factors in road crashes and that riders are more vulnerable than drivers, in the present study we investigated the effectiveness of an assistance system which signaled speed limit violations during a simulated moped-driving task, in optimal and poor visibility conditions. Participants performed four conditions of simulated riding: one baseline condition without Feedback, one Fog condition in which visual feedback was provided so as to indicate to the participants when a speed limit (lower than that indicated by the traffic signals) was exceeded, and two post-Feedback conditions with and without Fog, respectively, in which no feedback was delivered. Results showed that participants make fewer speeding violatio...

Research paper thumbnail of Transparency Heuristic: Effect of Implicitness of Online Data Acquisition on Sensitivity Perception

We present a study that investigates whether the transparency of the data acquisition technique c... more We present a study that investigates whether the transparency of the data acquisition technique can work as a heuristic when making evaluations about data protection and sensitivity. The study (N = 40) compares an explicit data acquisition technique (questionnaires) with an implicit one (eye-tracker) and varies also the actual sensitivity of the data collected (popularity evaluation vs. usability evaluation). The results suggest that, when judging general data sensitivity, the transparency of the data collection procedure might work as a heuristic; instead if more specific judgments or decisions are asked this effect is not observed. Implications are discussed.

Research paper thumbnail of A State Space Approach to Dynamic Modeling of Mouse-Tracking Data

Frontiers in Psychology, 2019

Mouse-tracking recording techniques are becoming very attractive in experimental psychology. They... more Mouse-tracking recording techniques are becoming very attractive in experimental psychology. They provide an effective means of enhancing the measurement of some real-time cognitive processes involved in categorization, decision-making, and lexical decision tasks. Mouse-tracking data are commonly analysed using a two-step procedure which first summarizes individuals' hand trajectories with independent measures, and then applies standard statistical models on them. However, this approach can be problematic in many cases. In particular, it does not provide a direct way to capitalize the richness of hand movement variability within a consistent and unified representation. In this article we present a novel, unified framework for mouse-tracking data. Unlike standard approaches to mouse-tracking, our proposal uses stochastic state-space modeling to represent the observed trajectories in terms of both individual movement dynamics and experimental variables. The model is estimated via a Metropolis-Hastings algorithm coupled with a non-linear recursive filter. The characteristics and potentials of the proposed approach are illustrated using a lexical decision case study. The results highlighted how dynamic modeling of mouse-tracking data can considerably improve the analysis of mouse-tracking tasks and the conclusions researchers can draw from them.

Research paper thumbnail of Cross-cultural perspective of driving style in young adults: Psychometric evaluation through the analysis of the Multidimensional Driving Style Inventory

Transportation Research Part F: Traffic Psychology and Behaviour, 2020

Abstract Self-evaluating methods are frequently used to identify driving styles. Among others, on... more Abstract Self-evaluating methods are frequently used to identify driving styles. Among others, one of the most commonly used questionnaires is the Multidimensional Driving Style Inventory (MDSI), developed for the Israeli population. Because of the extensive use of the questionnaire, the present paper aims to validate an Italian version and to confirm the 8-factor structure of the original one, i.e, dissociative, anxious, risky, angry, high-velocity, distress-reduction, patient, and careful driving style. The Italian version of the MDSI was filled out by 561 Italian drivers, who had a driving license for at least 1 year. A confirmatory factorial analysis (CFA) was conducted on the 44-item of the translated questionnaire showing not so good values of the goodness of fit tests (SRMR = 0.085; RMSEA = 0.063). The total-item correlation of each scale indicated that 4 items had a low index of total-item correlation. A second CFA was conducted on the remaining 40 items: goodness fit parameters improved (SRMR = 0.0685, RMSEA = 0.0584). Previous validations of the original version of MDSI for different populations (Argentine, Romanian, Chinese, Malaysian, Butch and Belgian) showed several critical issues in confirming the original structure. In the Italian version of MDSI validated in the present paper, the original 8-factor structure was confirmed by removing the 4 items which did not properly contribute to the factors. The results not only confirmed the usefulness of the MDSI in assessing driving style but they also indicated that the concept of driving style is considered in the same way in Italy and Israel, even though traffic rules are different. The latter consideration raises interesting questions for future research concerning cross-cultural comparisons of driving behavior in different countries.