Gopal
Gopal
Gopal
Gopal
Gopal
Gopal
Gopal
Gopal
Gopal
Gopal
font
Filter
×
2024
Thavanesan, Navamayooran; Farahi, Arya; Parfitt, Charlotte; Belkhatir, Zehor; Azim, Tayyaba; Vallejos, Elvira Perez; Walters, Zoë; Ramchurn, Sarvapali; Underwood, Timothy J.; Vigneswaran, Ganesh
Insights from explainable AI in oesophageal cancer team decisions Journal Article
In: Computers in Biology and Medicine, vol. 180, 2024, (For the purpose of open access, the authors have applied a Creative Commons attribution license (CC-BY) to any Author Accepted Manuscript version arising from this submission.).
Abstract | Links | BibTeX | Tags: Decision-making, machine learning, Multidisciplinary teams, Oesophageal cancer
@article{soton493238,
title = {Insights from explainable AI in oesophageal cancer team decisions},
author = {Navamayooran Thavanesan and Arya Farahi and Charlotte Parfitt and Zehor Belkhatir and Tayyaba Azim and Elvira Perez Vallejos and Zoë Walters and Sarvapali Ramchurn and Timothy J. Underwood and Ganesh Vigneswaran},
url = {https://eprints.soton.ac.uk/493238/},
year = {2024},
date = {2024-08-01},
journal = {Computers in Biology and Medicine},
volume = {180},
abstract = {ensuremath<pensuremath>Background: clinician-led quality control into oncological decision-making is crucial for optimising patient care. Explainable artificial intelligence (XAI) techniques provide data-driven approaches to unravel how clinical variables influence this decision-making. We applied global XAI techniques to examine the impact of key clinical decision-drivers when mapped by a machine learning (ML) model, on the likelihood of receiving different oesophageal cancer (OC) treatment modalities by the multidisciplinary team (MDT).ensuremath</pensuremath>ensuremath<pensuremath>Methods: retrospective analysis of 893 OC patients managed between 2010 and 2022 at our tertiary unit, used a random forests (RF) classifier to predict four possible treatment pathways as determined by the MDT: neoadjuvant chemotherapy followed by surgery (NACT + S), neoadjuvant chemoradiotherapy followed by surgery (NACRT + S), surgery-alone, and palliative management. Variable importance and partial dependence (PD) analyses then examined the influence of targeted high-ranking clinical variables within the ML model on treatment decisions as a surrogate model of the MDT decision-making dynamic.�ensuremath</pensuremath>ensuremath<pensuremath>Results: amongst guideline-variables known to determine treatments, such as Tumour-Node-Metastasis (TNM) staging, age also proved highly important to the RF model (16.1 % of total importance) on variable importance analysis. PD subsequently revealed that predicted probabilities for all treatment modalities change significantly after 75 years (p < 0.001). Likelihood of surgery-alone and palliative therapies increased for patients aged 75?85yrs but lowered for NACT/NACRT. Performance status divided patients into two clusters which influenced all predicted outcomes in conjunction with age.�ensuremath</pensuremath>ensuremath<pensuremath>Conclusion: XAI techniques delineate the relationship between clinical factors and OC treatment decisions. These techniques identify advanced age as heavily influencing decisions based on our model with a greater role in patients with specific tumour characteristics. This study methodology provides the means for exploring conscious/subconscious bias and interrogating inconsistencies in team-based decision-making within the era of AI-driven decision support.ensuremath</pensuremath>},
note = {For the purpose of open access, the authors have applied a Creative Commons attribution license (CC-BY) to any Author Accepted Manuscript version arising from this submission.},
keywords = {Decision-making, machine learning, Multidisciplinary teams, Oesophageal cancer},
pubstate = {published},
tppubtype = {article}
}
ensuremath<pensuremath>Background: clinician-led quality control into oncological decision-making is crucial for optimising patient care. Explainable artificial intelligence (XAI) techniques provide data-driven approaches to unravel how clinical variables influence this decision-making. We applied global XAI techniques to examine the impact of key clinical decision-drivers when mapped by a machine learning (ML) model, on the likelihood of receiving different oesophageal cancer (OC) treatment modalities by the multidisciplinary team (MDT).ensuremath</pensuremath>ensuremath<pensuremath>Methods: retrospective analysis of 893 OC patients managed between 2010 and 2022 at our tertiary unit, used a random forests (RF) classifier to predict four possible treatment pathways as determined by the MDT: neoadjuvant chemotherapy followed by surgery (NACT + S), neoadjuvant chemoradiotherapy followed by surgery (NACRT + S), surgery-alone, and palliative management. Variable importance and partial dependence (PD) analyses then examined the influence of targeted high-ranking clinical variables within the ML model on treatment decisions as a surrogate model of the MDT decision-making dynamic.�ensuremath</pensuremath>ensuremath<pensuremath>Results: amongst guideline-variables known to determine treatments, such as Tumour-Node-Metastasis (TNM) staging, age also proved highly important to the RF model (16.1 % of total importance) on variable importance analysis. PD subsequently revealed that predicted probabilities for all treatment modalities change significantly after 75 years (p < 0.001). Likelihood of surgery-alone and palliative therapies increased for patients aged 75?85yrs but lowered for NACT/NACRT. Performance status divided patients into two clusters which influenced all predicted outcomes in conjunction with age.�ensuremath</pensuremath>ensuremath<pensuremath>Conclusion: XAI techniques delineate the relationship between clinical factors and OC treatment decisions. These techniques identify advanced age as heavily influencing decisions based on our model with a greater role in patients with specific tumour characteristics. This study methodology provides the means for exploring conscious/subconscious bias and interrogating inconsistencies in team-based decision-making within the era of AI-driven decision support.ensuremath</pensuremath>
2023
Thavanesan, Navamayooran; Bodala, Indu; Walters, Zoe; Ramchurn, Sarvapali; Underwood, Timothy J.; Vigneswaran, Ganesh
Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer Journal Article
In: European Journal of Surgical Oncology, vol. 49, no. 11, 2023, (Publisher Copyright: © 2023 The Author(s)).
Abstract | Links | BibTeX | Tags: Artificial Intelligence, machine learning, Oesophageal cancer multidisciplinary team
@article{soton479497b,
title = {Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer},
author = {Navamayooran Thavanesan and Indu Bodala and Zoe Walters and Sarvapali Ramchurn and Timothy J. Underwood and Ganesh Vigneswaran},
url = {https://eprints.soton.ac.uk/479497/},
year = {2023},
date = {2023-11-01},
journal = {European Journal of Surgical Oncology},
volume = {49},
number = {11},
abstract = {ensuremath<pensuremath>Background: Rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables. Methods: Retrospective complete-case analysis of oesophagectomy patients $±$ neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model. Results: We identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32?83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [$±$0.045] vs 0.757 [$±$0.068], 0.740 [$±$0.042], and 0.709 [$±$0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p < 0.05). Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future.ensuremath</pensuremath>},
note = {Publisher Copyright:
© 2023 The Author(s)},
keywords = {Artificial Intelligence, machine learning, Oesophageal cancer multidisciplinary team},
pubstate = {published},
tppubtype = {article}
}
ensuremath<pensuremath>Background: Rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables. Methods: Retrospective complete-case analysis of oesophagectomy patients $±$ neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model. Results: We identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32?83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [$±$0.045] vs 0.757 [$±$0.068], 0.740 [$±$0.042], and 0.709 [$±$0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p < 0.05). Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future.ensuremath</pensuremath>
Thavanesan, Navamayooran; Bodala, Indu; Walters, Zoe; Ramchurn, Sarvapali; Underwood, Timothy J; Vigneswaran, Ganesh
Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer Journal Article
In: European Journal of Surgical Oncology, 2023, (Publisher Copyright: copyright 2023 The Author(s)).
Abstract | Links | BibTeX | Tags: Artificial Intelligence, machine learning, Oesophageal cancer multidisciplinary team
@article{soton479497,
title = {Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer},
author = {Navamayooran Thavanesan and Indu Bodala and Zoe Walters and Sarvapali Ramchurn and Timothy J Underwood and Ganesh Vigneswaran},
url = {https://eprints.soton.ac.uk/479497/},
year = {2023},
date = {2023-07-01},
journal = {European Journal of Surgical Oncology},
abstract = {ensuremath<pensuremath>Background: Rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables. Methods: Retrospective complete-case analysis of oesophagectomy patients $pm$ neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model. Results: We identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32?83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [$pm$0.045] vs 0.757 [$pm$0.068], 0.740 [$pm$0.042], and 0.709 [$pm$0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p < 0.05). Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future.ensuremath</pensuremath>},
note = {Publisher Copyright:
copyright 2023 The Author(s)},
keywords = {Artificial Intelligence, machine learning, Oesophageal cancer multidisciplinary team},
pubstate = {published},
tppubtype = {article}
}
ensuremath<pensuremath>Background: Rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables. Methods: Retrospective complete-case analysis of oesophagectomy patients $pm$ neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model. Results: We identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32?83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [$pm$0.045] vs 0.757 [$pm$0.068], 0.740 [$pm$0.042], and 0.709 [$pm$0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p < 0.05). Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future.ensuremath</pensuremath>
2014
Huynh, Trung Dong; Ebden, Mark; Ramchurn, Sarvapali; Roberts, Stephen; Moreau, Luc
Data quality assessment from provenance graphs Proceedings Article
In: Provenance Analytics 2014, 2014.
Abstract | Links | BibTeX | Tags: analytics, data quality, machine learning, network metrics, provenance
@inproceedings{eps365510,
title = {Data quality assessment from provenance graphs},
author = {Trung Dong Huynh and Mark Ebden and Sarvapali Ramchurn and Stephen Roberts and Luc Moreau},
url = {http://eprints.soton.ac.uk/365510/},
year = {2014},
date = {2014-01-01},
booktitle = {Provenance Analytics 2014},
abstract = {Provenance is a domain-independent means to represent what happened in an application, which can help verify data and infer data quality. Provenance patterns can manifest real-world phenomena such as a significant interest in a piece of content, providing an indication of its quality, or even issues such as undesirable interactions within a group of contributors. This paper presents an application-independent methodology for analyzing data based on the network metrics of provenance graphs to learn about such patterns and to relate them to data quality in an automated manner. Validating this method on the provenance records of CollabMap, an online crowdsourcing mapping application, we demonstrated an accuracy level of over 95% for the trust classification of data generated by the crowd therein.},
keywords = {analytics, data quality, machine learning, network metrics, provenance},
pubstate = {published},
tppubtype = {inproceedings}
}
Provenance is a domain-independent means to represent what happened in an application, which can help verify data and infer data quality. Provenance patterns can manifest real-world phenomena such as a significant interest in a piece of content, providing an indication of its quality, or even issues such as undesirable interactions within a group of contributors. This paper presents an application-independent methodology for analyzing data based on the network metrics of provenance graphs to learn about such patterns and to relate them to data quality in an automated manner. Validating this method on the provenance records of CollabMap, an online crowdsourcing mapping application, we demonstrated an accuracy level of over 95% for the trust classification of data generated by the crowd therein.
2011
Osborne, Michael A.; Rogers, Alex; Roberts, Stephen J.; Ramchurn, Sarvapali D.; Jennings, Nicholas R.
Gaussian Processes for Time Series Prediction Book Section
In: Bayesian Time Series Models, pp. 341–360, Cambridge University Press, 2011, (Chapter: 16).
Links | BibTeX | Tags: machine learning, mas
@incollection{eps272746,
title = {Gaussian Processes for Time Series Prediction},
author = {Michael A. Osborne and Alex Rogers and Stephen J. Roberts and Sarvapali D. Ramchurn and Nicholas R. Jennings},
url = {http://eprints.soton.ac.uk/272746/},
year = {2011},
date = {2011-01-01},
booktitle = {Bayesian Time Series Models},
pages = {341–360},
publisher = {Cambridge University Press},
note = {Chapter: 16},
keywords = {machine learning, mas},
pubstate = {published},
tppubtype = {incollection}
}
1.
Thavanesan, Navamayooran; Farahi, Arya; Parfitt, Charlotte; Belkhatir, Zehor; Azim, Tayyaba; Vallejos, Elvira Perez; Walters, Zoë; Ramchurn, Sarvapali; Underwood, Timothy J.; Vigneswaran, Ganesh
Insights from explainable AI in oesophageal cancer team decisions Journal Article
In: Computers in Biology and Medicine, vol. 180, 2024, (For the purpose of open access, the authors have applied a Creative Commons attribution license (CC-BY) to any Author Accepted Manuscript version arising from this submission.).
@article{soton493238,
title = {Insights from explainable AI in oesophageal cancer team decisions},
author = {Navamayooran Thavanesan and Arya Farahi and Charlotte Parfitt and Zehor Belkhatir and Tayyaba Azim and Elvira Perez Vallejos and Zoë Walters and Sarvapali Ramchurn and Timothy J. Underwood and Ganesh Vigneswaran},
url = {https://eprints.soton.ac.uk/493238/},
year = {2024},
date = {2024-08-01},
journal = {Computers in Biology and Medicine},
volume = {180},
abstract = {ensuremath<pensuremath>Background: clinician-led quality control into oncological decision-making is crucial for optimising patient care. Explainable artificial intelligence (XAI) techniques provide data-driven approaches to unravel how clinical variables influence this decision-making. We applied global XAI techniques to examine the impact of key clinical decision-drivers when mapped by a machine learning (ML) model, on the likelihood of receiving different oesophageal cancer (OC) treatment modalities by the multidisciplinary team (MDT).ensuremath</pensuremath>ensuremath<pensuremath>Methods: retrospective analysis of 893 OC patients managed between 2010 and 2022 at our tertiary unit, used a random forests (RF) classifier to predict four possible treatment pathways as determined by the MDT: neoadjuvant chemotherapy followed by surgery (NACT + S), neoadjuvant chemoradiotherapy followed by surgery (NACRT + S), surgery-alone, and palliative management. Variable importance and partial dependence (PD) analyses then examined the influence of targeted high-ranking clinical variables within the ML model on treatment decisions as a surrogate model of the MDT decision-making dynamic.�ensuremath</pensuremath>ensuremath<pensuremath>Results: amongst guideline-variables known to determine treatments, such as Tumour-Node-Metastasis (TNM) staging, age also proved highly important to the RF model (16.1 % of total importance) on variable importance analysis. PD subsequently revealed that predicted probabilities for all treatment modalities change significantly after 75 years (p < 0.001). Likelihood of surgery-alone and palliative therapies increased for patients aged 75?85yrs but lowered for NACT/NACRT. Performance status divided patients into two clusters which influenced all predicted outcomes in conjunction with age.�ensuremath</pensuremath>ensuremath<pensuremath>Conclusion: XAI techniques delineate the relationship between clinical factors and OC treatment decisions. These techniques identify advanced age as heavily influencing decisions based on our model with a greater role in patients with specific tumour characteristics. This study methodology provides the means for exploring conscious/subconscious bias and interrogating inconsistencies in team-based decision-making within the era of AI-driven decision support.ensuremath</pensuremath>},
note = {For the purpose of open access, the authors have applied a Creative Commons attribution license (CC-BY) to any Author Accepted Manuscript version arising from this submission.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
ensuremath<pensuremath>Background: clinician-led quality control into oncological decision-making is crucial for optimising patient care. Explainable artificial intelligence (XAI) techniques provide data-driven approaches to unravel how clinical variables influence this decision-making. We applied global XAI techniques to examine the impact of key clinical decision-drivers when mapped by a machine learning (ML) model, on the likelihood of receiving different oesophageal cancer (OC) treatment modalities by the multidisciplinary team (MDT).ensuremath</pensuremath>ensuremath<pensuremath>Methods: retrospective analysis of 893 OC patients managed between 2010 and 2022 at our tertiary unit, used a random forests (RF) classifier to predict four possible treatment pathways as determined by the MDT: neoadjuvant chemotherapy followed by surgery (NACT + S), neoadjuvant chemoradiotherapy followed by surgery (NACRT + S), surgery-alone, and palliative management. Variable importance and partial dependence (PD) analyses then examined the influence of targeted high-ranking clinical variables within the ML model on treatment decisions as a surrogate model of the MDT decision-making dynamic.�ensuremath</pensuremath>ensuremath<pensuremath>Results: amongst guideline-variables known to determine treatments, such as Tumour-Node-Metastasis (TNM) staging, age also proved highly important to the RF model (16.1 % of total importance) on variable importance analysis. PD subsequently revealed that predicted probabilities for all treatment modalities change significantly after 75 years (p < 0.001). Likelihood of surgery-alone and palliative therapies increased for patients aged 75?85yrs but lowered for NACT/NACRT. Performance status divided patients into two clusters which influenced all predicted outcomes in conjunction with age.�ensuremath</pensuremath>ensuremath<pensuremath>Conclusion: XAI techniques delineate the relationship between clinical factors and OC treatment decisions. These techniques identify advanced age as heavily influencing decisions based on our model with a greater role in patients with specific tumour characteristics. This study methodology provides the means for exploring conscious/subconscious bias and interrogating inconsistencies in team-based decision-making within the era of AI-driven decision support.ensuremath</pensuremath>
2.
Thavanesan, Navamayooran; Bodala, Indu; Walters, Zoe; Ramchurn, Sarvapali; Underwood, Timothy J.; Vigneswaran, Ganesh
Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer Journal Article
In: European Journal of Surgical Oncology, vol. 49, no. 11, 2023, (Publisher Copyright: © 2023 The Author(s)).
@article{soton479497b,
title = {Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer},
author = {Navamayooran Thavanesan and Indu Bodala and Zoe Walters and Sarvapali Ramchurn and Timothy J. Underwood and Ganesh Vigneswaran},
url = {https://eprints.soton.ac.uk/479497/},
year = {2023},
date = {2023-11-01},
journal = {European Journal of Surgical Oncology},
volume = {49},
number = {11},
abstract = {ensuremath<pensuremath>Background: Rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables. Methods: Retrospective complete-case analysis of oesophagectomy patients $±$ neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model. Results: We identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32?83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [$±$0.045] vs 0.757 [$±$0.068], 0.740 [$±$0.042], and 0.709 [$±$0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p < 0.05). Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future.ensuremath</pensuremath>},
note = {Publisher Copyright:
© 2023 The Author(s)},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
ensuremath<pensuremath>Background: Rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables. Methods: Retrospective complete-case analysis of oesophagectomy patients $±$ neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model. Results: We identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32?83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [$±$0.045] vs 0.757 [$±$0.068], 0.740 [$±$0.042], and 0.709 [$±$0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p < 0.05). Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future.ensuremath</pensuremath>
3.
Thavanesan, Navamayooran; Bodala, Indu; Walters, Zoe; Ramchurn, Sarvapali; Underwood, Timothy J; Vigneswaran, Ganesh
Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer Journal Article
In: European Journal of Surgical Oncology, 2023, (Publisher Copyright: copyright 2023 The Author(s)).
@article{soton479497,
title = {Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer},
author = {Navamayooran Thavanesan and Indu Bodala and Zoe Walters and Sarvapali Ramchurn and Timothy J Underwood and Ganesh Vigneswaran},
url = {https://eprints.soton.ac.uk/479497/},
year = {2023},
date = {2023-07-01},
journal = {European Journal of Surgical Oncology},
abstract = {ensuremath<pensuremath>Background: Rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables. Methods: Retrospective complete-case analysis of oesophagectomy patients $pm$ neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model. Results: We identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32?83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [$pm$0.045] vs 0.757 [$pm$0.068], 0.740 [$pm$0.042], and 0.709 [$pm$0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p < 0.05). Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future.ensuremath</pensuremath>},
note = {Publisher Copyright:
copyright 2023 The Author(s)},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
ensuremath<pensuremath>Background: Rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables. Methods: Retrospective complete-case analysis of oesophagectomy patients $pm$ neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model. Results: We identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32?83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [$pm$0.045] vs 0.757 [$pm$0.068], 0.740 [$pm$0.042], and 0.709 [$pm$0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p < 0.05). Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future.ensuremath</pensuremath>
4.
Huynh, Trung Dong; Ebden, Mark; Ramchurn, Sarvapali; Roberts, Stephen; Moreau, Luc
Data quality assessment from provenance graphs Proceedings Article
In: Provenance Analytics 2014, 2014.
@inproceedings{eps365510,
title = {Data quality assessment from provenance graphs},
author = {Trung Dong Huynh and Mark Ebden and Sarvapali Ramchurn and Stephen Roberts and Luc Moreau},
url = {http://eprints.soton.ac.uk/365510/},
year = {2014},
date = {2014-01-01},
booktitle = {Provenance Analytics 2014},
abstract = {Provenance is a domain-independent means to represent what happened in an application, which can help verify data and infer data quality. Provenance patterns can manifest real-world phenomena such as a significant interest in a piece of content, providing an indication of its quality, or even issues such as undesirable interactions within a group of contributors. This paper presents an application-independent methodology for analyzing data based on the network metrics of provenance graphs to learn about such patterns and to relate them to data quality in an automated manner. Validating this method on the provenance records of CollabMap, an online crowdsourcing mapping application, we demonstrated an accuracy level of over 95% for the trust classification of data generated by the crowd therein.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Provenance is a domain-independent means to represent what happened in an application, which can help verify data and infer data quality. Provenance patterns can manifest real-world phenomena such as a significant interest in a piece of content, providing an indication of its quality, or even issues such as undesirable interactions within a group of contributors. This paper presents an application-independent methodology for analyzing data based on the network metrics of provenance graphs to learn about such patterns and to relate them to data quality in an automated manner. Validating this method on the provenance records of CollabMap, an online crowdsourcing mapping application, we demonstrated an accuracy level of over 95% for the trust classification of data generated by the crowd therein.
5.
Osborne, Michael A.; Rogers, Alex; Roberts, Stephen J.; Ramchurn, Sarvapali D.; Jennings, Nicholas R.
Gaussian Processes for Time Series Prediction Book Section
In: Bayesian Time Series Models, pp. 341–360, Cambridge University Press, 2011, (Chapter: 16).
@incollection{eps272746,
title = {Gaussian Processes for Time Series Prediction},
author = {Michael A. Osborne and Alex Rogers and Stephen J. Roberts and Sarvapali D. Ramchurn and Nicholas R. Jennings},
url = {http://eprints.soton.ac.uk/272746/},
year = {2011},
date = {2011-01-01},
booktitle = {Bayesian Time Series Models},
pages = {341–360},
publisher = {Cambridge University Press},
note = {Chapter: 16},
keywords = {},
pubstate = {published},
tppubtype = {incollection}
}
2024
Thavanesan, Navamayooran; Farahi, Arya; Parfitt, Charlotte; Belkhatir, Zehor; Azim, Tayyaba; Vallejos, Elvira Perez; Walters, Zoë; Ramchurn, Sarvapali; Underwood, Timothy J.; Vigneswaran, Ganesh
Insights from explainable AI in oesophageal cancer team decisions Journal Article
In: Computers in Biology and Medicine, vol. 180, 2024, (For the purpose of open access, the authors have applied a Creative Commons attribution license (CC-BY) to any Author Accepted Manuscript version arising from this submission.).
Abstract | Links | BibTeX | Tags: Decision-making, machine learning, Multidisciplinary teams, Oesophageal cancer
@article{soton493238,
title = {Insights from explainable AI in oesophageal cancer team decisions},
author = {Navamayooran Thavanesan and Arya Farahi and Charlotte Parfitt and Zehor Belkhatir and Tayyaba Azim and Elvira Perez Vallejos and Zoë Walters and Sarvapali Ramchurn and Timothy J. Underwood and Ganesh Vigneswaran},
url = {https://eprints.soton.ac.uk/493238/},
year = {2024},
date = {2024-08-01},
journal = {Computers in Biology and Medicine},
volume = {180},
abstract = {ensuremath<pensuremath>Background: clinician-led quality control into oncological decision-making is crucial for optimising patient care. Explainable artificial intelligence (XAI) techniques provide data-driven approaches to unravel how clinical variables influence this decision-making. We applied global XAI techniques to examine the impact of key clinical decision-drivers when mapped by a machine learning (ML) model, on the likelihood of receiving different oesophageal cancer (OC) treatment modalities by the multidisciplinary team (MDT).ensuremath</pensuremath>ensuremath<pensuremath>Methods: retrospective analysis of 893 OC patients managed between 2010 and 2022 at our tertiary unit, used a random forests (RF) classifier to predict four possible treatment pathways as determined by the MDT: neoadjuvant chemotherapy followed by surgery (NACT + S), neoadjuvant chemoradiotherapy followed by surgery (NACRT + S), surgery-alone, and palliative management. Variable importance and partial dependence (PD) analyses then examined the influence of targeted high-ranking clinical variables within the ML model on treatment decisions as a surrogate model of the MDT decision-making dynamic.�ensuremath</pensuremath>ensuremath<pensuremath>Results: amongst guideline-variables known to determine treatments, such as Tumour-Node-Metastasis (TNM) staging, age also proved highly important to the RF model (16.1 % of total importance) on variable importance analysis. PD subsequently revealed that predicted probabilities for all treatment modalities change significantly after 75 years (p < 0.001). Likelihood of surgery-alone and palliative therapies increased for patients aged 75?85yrs but lowered for NACT/NACRT. Performance status divided patients into two clusters which influenced all predicted outcomes in conjunction with age.�ensuremath</pensuremath>ensuremath<pensuremath>Conclusion: XAI techniques delineate the relationship between clinical factors and OC treatment decisions. These techniques identify advanced age as heavily influencing decisions based on our model with a greater role in patients with specific tumour characteristics. This study methodology provides the means for exploring conscious/subconscious bias and interrogating inconsistencies in team-based decision-making within the era of AI-driven decision support.ensuremath</pensuremath>},
note = {For the purpose of open access, the authors have applied a Creative Commons attribution license (CC-BY) to any Author Accepted Manuscript version arising from this submission.},
keywords = {Decision-making, machine learning, Multidisciplinary teams, Oesophageal cancer},
pubstate = {published},
tppubtype = {article}
}
ensuremath<pensuremath>Background: clinician-led quality control into oncological decision-making is crucial for optimising patient care. Explainable artificial intelligence (XAI) techniques provide data-driven approaches to unravel how clinical variables influence this decision-making. We applied global XAI techniques to examine the impact of key clinical decision-drivers when mapped by a machine learning (ML) model, on the likelihood of receiving different oesophageal cancer (OC) treatment modalities by the multidisciplinary team (MDT).ensuremath</pensuremath>ensuremath<pensuremath>Methods: retrospective analysis of 893 OC patients managed between 2010 and 2022 at our tertiary unit, used a random forests (RF) classifier to predict four possible treatment pathways as determined by the MDT: neoadjuvant chemotherapy followed by surgery (NACT + S), neoadjuvant chemoradiotherapy followed by surgery (NACRT + S), surgery-alone, and palliative management. Variable importance and partial dependence (PD) analyses then examined the influence of targeted high-ranking clinical variables within the ML model on treatment decisions as a surrogate model of the MDT decision-making dynamic.�ensuremath</pensuremath>ensuremath<pensuremath>Results: amongst guideline-variables known to determine treatments, such as Tumour-Node-Metastasis (TNM) staging, age also proved highly important to the RF model (16.1 % of total importance) on variable importance analysis. PD subsequently revealed that predicted probabilities for all treatment modalities change significantly after 75 years (p < 0.001). Likelihood of surgery-alone and palliative therapies increased for patients aged 75?85yrs but lowered for NACT/NACRT. Performance status divided patients into two clusters which influenced all predicted outcomes in conjunction with age.�ensuremath</pensuremath>ensuremath<pensuremath>Conclusion: XAI techniques delineate the relationship between clinical factors and OC treatment decisions. These techniques identify advanced age as heavily influencing decisions based on our model with a greater role in patients with specific tumour characteristics. This study methodology provides the means for exploring conscious/subconscious bias and interrogating inconsistencies in team-based decision-making within the era of AI-driven decision support.ensuremath</pensuremath>
2023
Thavanesan, Navamayooran; Bodala, Indu; Walters, Zoe; Ramchurn, Sarvapali; Underwood, Timothy J.; Vigneswaran, Ganesh
Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer Journal Article
In: European Journal of Surgical Oncology, vol. 49, no. 11, 2023, (Publisher Copyright: © 2023 The Author(s)).
Abstract | Links | BibTeX | Tags: Artificial Intelligence, machine learning, Oesophageal cancer multidisciplinary team
@article{soton479497b,
title = {Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer},
author = {Navamayooran Thavanesan and Indu Bodala and Zoe Walters and Sarvapali Ramchurn and Timothy J. Underwood and Ganesh Vigneswaran},
url = {https://eprints.soton.ac.uk/479497/},
year = {2023},
date = {2023-11-01},
journal = {European Journal of Surgical Oncology},
volume = {49},
number = {11},
abstract = {ensuremath<pensuremath>Background: Rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables. Methods: Retrospective complete-case analysis of oesophagectomy patients $±$ neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model. Results: We identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32?83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [$±$0.045] vs 0.757 [$±$0.068], 0.740 [$±$0.042], and 0.709 [$±$0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p < 0.05). Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future.ensuremath</pensuremath>},
note = {Publisher Copyright:
© 2023 The Author(s)},
keywords = {Artificial Intelligence, machine learning, Oesophageal cancer multidisciplinary team},
pubstate = {published},
tppubtype = {article}
}
ensuremath<pensuremath>Background: Rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables. Methods: Retrospective complete-case analysis of oesophagectomy patients $±$ neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model. Results: We identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32?83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [$±$0.045] vs 0.757 [$±$0.068], 0.740 [$±$0.042], and 0.709 [$±$0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p < 0.05). Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future.ensuremath</pensuremath>
Thavanesan, Navamayooran; Bodala, Indu; Walters, Zoe; Ramchurn, Sarvapali; Underwood, Timothy J; Vigneswaran, Ganesh
Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer Journal Article
In: European Journal of Surgical Oncology, 2023, (Publisher Copyright: copyright 2023 The Author(s)).
Abstract | Links | BibTeX | Tags: Artificial Intelligence, machine learning, Oesophageal cancer multidisciplinary team
@article{soton479497,
title = {Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer},
author = {Navamayooran Thavanesan and Indu Bodala and Zoe Walters and Sarvapali Ramchurn and Timothy J Underwood and Ganesh Vigneswaran},
url = {https://eprints.soton.ac.uk/479497/},
year = {2023},
date = {2023-07-01},
journal = {European Journal of Surgical Oncology},
abstract = {ensuremath<pensuremath>Background: Rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables. Methods: Retrospective complete-case analysis of oesophagectomy patients $pm$ neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model. Results: We identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32?83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [$pm$0.045] vs 0.757 [$pm$0.068], 0.740 [$pm$0.042], and 0.709 [$pm$0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p < 0.05). Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future.ensuremath</pensuremath>},
note = {Publisher Copyright:
copyright 2023 The Author(s)},
keywords = {Artificial Intelligence, machine learning, Oesophageal cancer multidisciplinary team},
pubstate = {published},
tppubtype = {article}
}
ensuremath<pensuremath>Background: Rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables. Methods: Retrospective complete-case analysis of oesophagectomy patients $pm$ neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model. Results: We identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32?83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [$pm$0.045] vs 0.757 [$pm$0.068], 0.740 [$pm$0.042], and 0.709 [$pm$0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p < 0.05). Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future.ensuremath</pensuremath>
2014
Huynh, Trung Dong; Ebden, Mark; Ramchurn, Sarvapali; Roberts, Stephen; Moreau, Luc
Data quality assessment from provenance graphs Proceedings Article
In: Provenance Analytics 2014, 2014.
Abstract | Links | BibTeX | Tags: analytics, data quality, machine learning, network metrics, provenance
@inproceedings{eps365510,
title = {Data quality assessment from provenance graphs},
author = {Trung Dong Huynh and Mark Ebden and Sarvapali Ramchurn and Stephen Roberts and Luc Moreau},
url = {http://eprints.soton.ac.uk/365510/},
year = {2014},
date = {2014-01-01},
booktitle = {Provenance Analytics 2014},
abstract = {Provenance is a domain-independent means to represent what happened in an application, which can help verify data and infer data quality. Provenance patterns can manifest real-world phenomena such as a significant interest in a piece of content, providing an indication of its quality, or even issues such as undesirable interactions within a group of contributors. This paper presents an application-independent methodology for analyzing data based on the network metrics of provenance graphs to learn about such patterns and to relate them to data quality in an automated manner. Validating this method on the provenance records of CollabMap, an online crowdsourcing mapping application, we demonstrated an accuracy level of over 95% for the trust classification of data generated by the crowd therein.},
keywords = {analytics, data quality, machine learning, network metrics, provenance},
pubstate = {published},
tppubtype = {inproceedings}
}
Provenance is a domain-independent means to represent what happened in an application, which can help verify data and infer data quality. Provenance patterns can manifest real-world phenomena such as a significant interest in a piece of content, providing an indication of its quality, or even issues such as undesirable interactions within a group of contributors. This paper presents an application-independent methodology for analyzing data based on the network metrics of provenance graphs to learn about such patterns and to relate them to data quality in an automated manner. Validating this method on the provenance records of CollabMap, an online crowdsourcing mapping application, we demonstrated an accuracy level of over 95% for the trust classification of data generated by the crowd therein.
2011
Osborne, Michael A.; Rogers, Alex; Roberts, Stephen J.; Ramchurn, Sarvapali D.; Jennings, Nicholas R.
Gaussian Processes for Time Series Prediction Book Section
In: Bayesian Time Series Models, pp. 341–360, Cambridge University Press, 2011, (Chapter: 16).
Links | BibTeX | Tags: machine learning, mas
@incollection{eps272746,
title = {Gaussian Processes for Time Series Prediction},
author = {Michael A. Osborne and Alex Rogers and Stephen J. Roberts and Sarvapali D. Ramchurn and Nicholas R. Jennings},
url = {http://eprints.soton.ac.uk/272746/},
year = {2011},
date = {2011-01-01},
booktitle = {Bayesian Time Series Models},
pages = {341–360},
publisher = {Cambridge University Press},
note = {Chapter: 16},
keywords = {machine learning, mas},
pubstate = {published},
tppubtype = {incollection}
}
1.
Thavanesan, Navamayooran; Farahi, Arya; Parfitt, Charlotte; Belkhatir, Zehor; Azim, Tayyaba; Vallejos, Elvira Perez; Walters, Zoë; Ramchurn, Sarvapali; Underwood, Timothy J.; Vigneswaran, Ganesh
Insights from explainable AI in oesophageal cancer team decisions Journal Article
In: Computers in Biology and Medicine, vol. 180, 2024, (For the purpose of open access, the authors have applied a Creative Commons attribution license (CC-BY) to any Author Accepted Manuscript version arising from this submission.).
@article{soton493238,
title = {Insights from explainable AI in oesophageal cancer team decisions},
author = {Navamayooran Thavanesan and Arya Farahi and Charlotte Parfitt and Zehor Belkhatir and Tayyaba Azim and Elvira Perez Vallejos and Zoë Walters and Sarvapali Ramchurn and Timothy J. Underwood and Ganesh Vigneswaran},
url = {https://eprints.soton.ac.uk/493238/},
year = {2024},
date = {2024-08-01},
journal = {Computers in Biology and Medicine},
volume = {180},
abstract = {ensuremath<pensuremath>Background: clinician-led quality control into oncological decision-making is crucial for optimising patient care. Explainable artificial intelligence (XAI) techniques provide data-driven approaches to unravel how clinical variables influence this decision-making. We applied global XAI techniques to examine the impact of key clinical decision-drivers when mapped by a machine learning (ML) model, on the likelihood of receiving different oesophageal cancer (OC) treatment modalities by the multidisciplinary team (MDT).ensuremath</pensuremath>ensuremath<pensuremath>Methods: retrospective analysis of 893 OC patients managed between 2010 and 2022 at our tertiary unit, used a random forests (RF) classifier to predict four possible treatment pathways as determined by the MDT: neoadjuvant chemotherapy followed by surgery (NACT + S), neoadjuvant chemoradiotherapy followed by surgery (NACRT + S), surgery-alone, and palliative management. Variable importance and partial dependence (PD) analyses then examined the influence of targeted high-ranking clinical variables within the ML model on treatment decisions as a surrogate model of the MDT decision-making dynamic.�ensuremath</pensuremath>ensuremath<pensuremath>Results: amongst guideline-variables known to determine treatments, such as Tumour-Node-Metastasis (TNM) staging, age also proved highly important to the RF model (16.1 % of total importance) on variable importance analysis. PD subsequently revealed that predicted probabilities for all treatment modalities change significantly after 75 years (p < 0.001). Likelihood of surgery-alone and palliative therapies increased for patients aged 75?85yrs but lowered for NACT/NACRT. Performance status divided patients into two clusters which influenced all predicted outcomes in conjunction with age.�ensuremath</pensuremath>ensuremath<pensuremath>Conclusion: XAI techniques delineate the relationship between clinical factors and OC treatment decisions. These techniques identify advanced age as heavily influencing decisions based on our model with a greater role in patients with specific tumour characteristics. This study methodology provides the means for exploring conscious/subconscious bias and interrogating inconsistencies in team-based decision-making within the era of AI-driven decision support.ensuremath</pensuremath>},
note = {For the purpose of open access, the authors have applied a Creative Commons attribution license (CC-BY) to any Author Accepted Manuscript version arising from this submission.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
ensuremath<pensuremath>Background: clinician-led quality control into oncological decision-making is crucial for optimising patient care. Explainable artificial intelligence (XAI) techniques provide data-driven approaches to unravel how clinical variables influence this decision-making. We applied global XAI techniques to examine the impact of key clinical decision-drivers when mapped by a machine learning (ML) model, on the likelihood of receiving different oesophageal cancer (OC) treatment modalities by the multidisciplinary team (MDT).ensuremath</pensuremath>ensuremath<pensuremath>Methods: retrospective analysis of 893 OC patients managed between 2010 and 2022 at our tertiary unit, used a random forests (RF) classifier to predict four possible treatment pathways as determined by the MDT: neoadjuvant chemotherapy followed by surgery (NACT + S), neoadjuvant chemoradiotherapy followed by surgery (NACRT + S), surgery-alone, and palliative management. Variable importance and partial dependence (PD) analyses then examined the influence of targeted high-ranking clinical variables within the ML model on treatment decisions as a surrogate model of the MDT decision-making dynamic.�ensuremath</pensuremath>ensuremath<pensuremath>Results: amongst guideline-variables known to determine treatments, such as Tumour-Node-Metastasis (TNM) staging, age also proved highly important to the RF model (16.1 % of total importance) on variable importance analysis. PD subsequently revealed that predicted probabilities for all treatment modalities change significantly after 75 years (p < 0.001). Likelihood of surgery-alone and palliative therapies increased for patients aged 75?85yrs but lowered for NACT/NACRT. Performance status divided patients into two clusters which influenced all predicted outcomes in conjunction with age.�ensuremath</pensuremath>ensuremath<pensuremath>Conclusion: XAI techniques delineate the relationship between clinical factors and OC treatment decisions. These techniques identify advanced age as heavily influencing decisions based on our model with a greater role in patients with specific tumour characteristics. This study methodology provides the means for exploring conscious/subconscious bias and interrogating inconsistencies in team-based decision-making within the era of AI-driven decision support.ensuremath</pensuremath>
2.
Thavanesan, Navamayooran; Bodala, Indu; Walters, Zoe; Ramchurn, Sarvapali; Underwood, Timothy J.; Vigneswaran, Ganesh
Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer Journal Article
In: European Journal of Surgical Oncology, vol. 49, no. 11, 2023, (Publisher Copyright: © 2023 The Author(s)).
@article{soton479497b,
title = {Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer},
author = {Navamayooran Thavanesan and Indu Bodala and Zoe Walters and Sarvapali Ramchurn and Timothy J. Underwood and Ganesh Vigneswaran},
url = {https://eprints.soton.ac.uk/479497/},
year = {2023},
date = {2023-11-01},
journal = {European Journal of Surgical Oncology},
volume = {49},
number = {11},
abstract = {ensuremath<pensuremath>Background: Rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables. Methods: Retrospective complete-case analysis of oesophagectomy patients $±$ neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model. Results: We identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32?83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [$±$0.045] vs 0.757 [$±$0.068], 0.740 [$±$0.042], and 0.709 [$±$0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p < 0.05). Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future.ensuremath</pensuremath>},
note = {Publisher Copyright:
© 2023 The Author(s)},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
ensuremath<pensuremath>Background: Rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables. Methods: Retrospective complete-case analysis of oesophagectomy patients $±$ neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model. Results: We identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32?83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [$±$0.045] vs 0.757 [$±$0.068], 0.740 [$±$0.042], and 0.709 [$±$0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p < 0.05). Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future.ensuremath</pensuremath>
3.
Thavanesan, Navamayooran; Bodala, Indu; Walters, Zoe; Ramchurn, Sarvapali; Underwood, Timothy J; Vigneswaran, Ganesh
Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer Journal Article
In: European Journal of Surgical Oncology, 2023, (Publisher Copyright: copyright 2023 The Author(s)).
@article{soton479497,
title = {Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer},
author = {Navamayooran Thavanesan and Indu Bodala and Zoe Walters and Sarvapali Ramchurn and Timothy J Underwood and Ganesh Vigneswaran},
url = {https://eprints.soton.ac.uk/479497/},
year = {2023},
date = {2023-07-01},
journal = {European Journal of Surgical Oncology},
abstract = {ensuremath<pensuremath>Background: Rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables. Methods: Retrospective complete-case analysis of oesophagectomy patients $pm$ neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model. Results: We identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32?83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [$pm$0.045] vs 0.757 [$pm$0.068], 0.740 [$pm$0.042], and 0.709 [$pm$0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p < 0.05). Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future.ensuremath</pensuremath>},
note = {Publisher Copyright:
copyright 2023 The Author(s)},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
ensuremath<pensuremath>Background: Rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables. Methods: Retrospective complete-case analysis of oesophagectomy patients $pm$ neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model. Results: We identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32?83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [$pm$0.045] vs 0.757 [$pm$0.068], 0.740 [$pm$0.042], and 0.709 [$pm$0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p < 0.05). Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future.ensuremath</pensuremath>
4.
Huynh, Trung Dong; Ebden, Mark; Ramchurn, Sarvapali; Roberts, Stephen; Moreau, Luc
Data quality assessment from provenance graphs Proceedings Article
In: Provenance Analytics 2014, 2014.
@inproceedings{eps365510,
title = {Data quality assessment from provenance graphs},
author = {Trung Dong Huynh and Mark Ebden and Sarvapali Ramchurn and Stephen Roberts and Luc Moreau},
url = {http://eprints.soton.ac.uk/365510/},
year = {2014},
date = {2014-01-01},
booktitle = {Provenance Analytics 2014},
abstract = {Provenance is a domain-independent means to represent what happened in an application, which can help verify data and infer data quality. Provenance patterns can manifest real-world phenomena such as a significant interest in a piece of content, providing an indication of its quality, or even issues such as undesirable interactions within a group of contributors. This paper presents an application-independent methodology for analyzing data based on the network metrics of provenance graphs to learn about such patterns and to relate them to data quality in an automated manner. Validating this method on the provenance records of CollabMap, an online crowdsourcing mapping application, we demonstrated an accuracy level of over 95% for the trust classification of data generated by the crowd therein.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Provenance is a domain-independent means to represent what happened in an application, which can help verify data and infer data quality. Provenance patterns can manifest real-world phenomena such as a significant interest in a piece of content, providing an indication of its quality, or even issues such as undesirable interactions within a group of contributors. This paper presents an application-independent methodology for analyzing data based on the network metrics of provenance graphs to learn about such patterns and to relate them to data quality in an automated manner. Validating this method on the provenance records of CollabMap, an online crowdsourcing mapping application, we demonstrated an accuracy level of over 95% for the trust classification of data generated by the crowd therein.
5.
Osborne, Michael A.; Rogers, Alex; Roberts, Stephen J.; Ramchurn, Sarvapali D.; Jennings, Nicholas R.
Gaussian Processes for Time Series Prediction Book Section
In: Bayesian Time Series Models, pp. 341–360, Cambridge University Press, 2011, (Chapter: 16).
@incollection{eps272746,
title = {Gaussian Processes for Time Series Prediction},
author = {Michael A. Osborne and Alex Rogers and Stephen J. Roberts and Sarvapali D. Ramchurn and Nicholas R. Jennings},
url = {http://eprints.soton.ac.uk/272746/},
year = {2011},
date = {2011-01-01},
booktitle = {Bayesian Time Series Models},
pages = {341–360},
publisher = {Cambridge University Press},
note = {Chapter: 16},
keywords = {},
pubstate = {published},
tppubtype = {incollection}
}
Selected Publications
Multi-agent signal-less intersection management with dynamic platoon formation
No data available.
https://eprints.soton.ac.uk/478647/
@inproceedings{soton478647,
title = {Multi-agent signal-less intersection management with dynamic platoon formation},
author = {Phuriwat Worrawichaipat and Enrico Gerding and Ioannis Kaparias and Sarvapali Ramchurn},
url = {https://eprints.soton.ac.uk/478647/},
year = {2023},
date = {2023-05-01},
booktitle = {22nd International Conference on Autonomous Agents and Multiagent Systems (29/05/23 - 02/06/23)},
pages = {1542--1550},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
title = {Multi-agent signal-less intersection management with dynamic platoon formation},
author = {Phuriwat Worrawichaipat and Enrico Gerding and Ioannis Kaparias and Sarvapali Ramchurn},
url = {https://eprints.soton.ac.uk/478647/},
year = {2023},
date = {2023-05-01},
booktitle = {22nd International Conference on Autonomous Agents and Multiagent Systems (29/05/23 - 02/06/23)},
pages = {1542--1550},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
AI Foundation Models: initial review, CMA Consultation, TAS Hub Response
No data available.
https://eprints.soton.ac.uk/477553/
@misc{soton477553,
title = {AI Foundation Models: initial review, CMA Consultation, TAS Hub Response},
author = {Joshua Krook and Derek McAuley and Stuart Anderson and John Downer and Peter Winter and Sarvapali D Ramchurn},
url = {https://eprints.soton.ac.uk/477553/},
year = {2023},
date = {2023-06-01},
publisher = {University of Southampton},
keywords = {},
pubstate = {published},
tppubtype = {misc}
}
title = {AI Foundation Models: initial review, CMA Consultation, TAS Hub Response},
author = {Joshua Krook and Derek McAuley and Stuart Anderson and John Downer and Peter Winter and Sarvapali D Ramchurn},
url = {https://eprints.soton.ac.uk/477553/},
year = {2023},
date = {2023-06-01},
publisher = {University of Southampton},
keywords = {},
pubstate = {published},
tppubtype = {misc}
}
The effect of data visualisation quality and task density on human-swarm interaction
No data available.
https://eprints.soton.ac.uk/479970/
@inproceedings{soton479970,
title = {The effect of data visualisation quality and task density on human-swarm interaction},
author = {Ayodeji Abioye and Mohammad Naiseh and William Hunt and Jediah R Clark and Sarvapali D Ramchurn and Mohammad Soorati},
url = {https://eprints.soton.ac.uk/479970/},
year = {2023},
date = {2023-06-01},
booktitle = {Proceedings of the 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)},
publisher = {IEEE},
abstract = {Despite the advantages of having robot swarms, human supervision is required for real-world applications. The performance of the human-swarm system depends on several factors including the data availability for the human operators. In this paper, we study the human factors aspect of the human-swarm interaction and investigate how having access to high-quality data can affect the performance of the human-swarm system - the number of tasks completed and the human trust level in operation. We designed an experiment where a human operator is tasked to operate a swarm to identify casualties in an area within a given time period. One group of operators had the option to request high-quality pictures while the other group had to base their decision on the available low-quality images. We performed a user study with 120 participants and recorded their success rate (directly logged via the simulation platform) as well as their workload and trust level (measured through a questionnaire after completing a human-swarm scenario). The findings from our study indicated that the group granted access to high-quality data exhibited an increased workload and placed greater trust in the swarm, thus confirming our initial hypothesis. However, we also found that the number of accurately identified casualties did not significantly vary between the two groups, suggesting that data quality had no impact on the successful completion of tasks.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
title = {The effect of data visualisation quality and task density on human-swarm interaction},
author = {Ayodeji Abioye and Mohammad Naiseh and William Hunt and Jediah R Clark and Sarvapali D Ramchurn and Mohammad Soorati},
url = {https://eprints.soton.ac.uk/479970/},
year = {2023},
date = {2023-06-01},
booktitle = {Proceedings of the 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)},
publisher = {IEEE},
abstract = {Despite the advantages of having robot swarms, human supervision is required for real-world applications. The performance of the human-swarm system depends on several factors including the data availability for the human operators. In this paper, we study the human factors aspect of the human-swarm interaction and investigate how having access to high-quality data can affect the performance of the human-swarm system - the number of tasks completed and the human trust level in operation. We designed an experiment where a human operator is tasked to operate a swarm to identify casualties in an area within a given time period. One group of operators had the option to request high-quality pictures while the other group had to base their decision on the available low-quality images. We performed a user study with 120 participants and recorded their success rate (directly logged via the simulation platform) as well as their workload and trust level (measured through a questionnaire after completing a human-swarm scenario). The findings from our study indicated that the group granted access to high-quality data exhibited an increased workload and placed greater trust in the swarm, thus confirming our initial hypothesis. However, we also found that the number of accurately identified casualties did not significantly vary between the two groups, suggesting that data quality had no impact on the successful completion of tasks.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Demonstrating performance benefits of human-swarm teaming
Autonomous swarms of robots can bring robustness, scalability and adaptability to safety-critical tasks such as search and rescue but their application is still very limited. Using semi-autonomous swarms with human control can bring robot swarms to real-world applications. Human operators can define goals for the swarm, monitor their performance and interfere with, or overrule, the decisions and behaviour. We present the "Human And Robot Interactive Swarm'' simulator (HARIS) that allows multi-user interaction with a robot swarm and facilitates qualitative and quantitative user studies through simulation of robot swarms completing tasks, from package delivery to search and rescue, with varying levels of human control. In this demonstration, we showcase the simulator by using it to study the performance gain offered by maintaining a "human-in-the-loop'' over a fully autonomous system as an example. This is illustrated in the context of search and rescue, with an autonomous allocation of resources to those in need.
https://eprints.soton.ac.uk/479903/
@inproceedings{soton479903,
title = {Demonstrating performance benefits of human-swarm teaming},
author = {William Hunt and Jack Ryan and Ayodeji O Abioye and Sarvapali D Ramchurn and Mohammad D Soorati},
url = {https://eprints.soton.ac.uk/479903/},
year = {2023},
date = {2023-05-01},
booktitle = {Proceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems},
pages = {3062--3064},
publisher = {International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS)},
abstract = {Autonomous swarms of robots can bring robustness, scalability and adaptability to safety-critical tasks such as search and rescue but their application is still very limited. Using semi-autonomous swarms with human control can bring robot swarms to real-world applications. Human operators can define goals for the swarm, monitor their performance and interfere with, or overrule, the decisions and behaviour. We present the "Human And Robot Interactive Swarm'' simulator (HARIS) that allows multi-user interaction with a robot swarm and facilitates qualitative and quantitative user studies through simulation of robot swarms completing tasks, from package delivery to search and rescue, with varying levels of human control. In this demonstration, we showcase the simulator by using it to study the performance gain offered by maintaining a "human-in-the-loop'' over a fully autonomous system as an example. This is illustrated in the context of search and rescue, with an autonomous allocation of resources to those in need.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
title = {Demonstrating performance benefits of human-swarm teaming},
author = {William Hunt and Jack Ryan and Ayodeji O Abioye and Sarvapali D Ramchurn and Mohammad D Soorati},
url = {https://eprints.soton.ac.uk/479903/},
year = {2023},
date = {2023-05-01},
booktitle = {Proceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems},
pages = {3062--3064},
publisher = {International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS)},
abstract = {Autonomous swarms of robots can bring robustness, scalability and adaptability to safety-critical tasks such as search and rescue but their application is still very limited. Using semi-autonomous swarms with human control can bring robot swarms to real-world applications. Human operators can define goals for the swarm, monitor their performance and interfere with, or overrule, the decisions and behaviour. We present the "Human And Robot Interactive Swarm'' simulator (HARIS) that allows multi-user interaction with a robot swarm and facilitates qualitative and quantitative user studies through simulation of robot swarms completing tasks, from package delivery to search and rescue, with varying levels of human control. In this demonstration, we showcase the simulator by using it to study the performance gain offered by maintaining a "human-in-the-loop'' over a fully autonomous system as an example. This is illustrated in the context of search and rescue, with an autonomous allocation of resources to those in need.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
2024
Thavanesan, Navamayooran; Farahi, Arya; Parfitt, Charlotte; Belkhatir, Zehor; Azim, Tayyaba; Vallejos, Elvira Perez; Walters, Zoë; Ramchurn, Sarvapali; Underwood, Timothy J.; Vigneswaran, Ganesh
Insights from explainable AI in oesophageal cancer team decisions Journal Article
In: Computers in Biology and Medicine, vol. 180, 2024, (For the purpose of open access, the authors have applied a Creative Commons attribution license (CC-BY) to any Author Accepted Manuscript version arising from this submission.).
@article{soton493238,
title = {Insights from explainable AI in oesophageal cancer team decisions},
author = {Navamayooran Thavanesan and Arya Farahi and Charlotte Parfitt and Zehor Belkhatir and Tayyaba Azim and Elvira Perez Vallejos and Zoë Walters and Sarvapali Ramchurn and Timothy J. Underwood and Ganesh Vigneswaran},
url = {https://eprints.soton.ac.uk/493238/},
year = {2024},
date = {2024-08-01},
journal = {Computers in Biology and Medicine},
volume = {180},
abstract = {ensuremath<pensuremath>Background: clinician-led quality control into oncological decision-making is crucial for optimising patient care. Explainable artificial intelligence (XAI) techniques provide data-driven approaches to unravel how clinical variables influence this decision-making. We applied global XAI techniques to examine the impact of key clinical decision-drivers when mapped by a machine learning (ML) model, on the likelihood of receiving different oesophageal cancer (OC) treatment modalities by the multidisciplinary team (MDT).ensuremath</pensuremath>ensuremath<pensuremath>Methods: retrospective analysis of 893 OC patients managed between 2010 and 2022 at our tertiary unit, used a random forests (RF) classifier to predict four possible treatment pathways as determined by the MDT: neoadjuvant chemotherapy followed by surgery (NACT + S), neoadjuvant chemoradiotherapy followed by surgery (NACRT + S), surgery-alone, and palliative management. Variable importance and partial dependence (PD) analyses then examined the influence of targeted high-ranking clinical variables within the ML model on treatment decisions as a surrogate model of the MDT decision-making dynamic.�ensuremath</pensuremath>ensuremath<pensuremath>Results: amongst guideline-variables known to determine treatments, such as Tumour-Node-Metastasis (TNM) staging, age also proved highly important to the RF model (16.1 % of total importance) on variable importance analysis. PD subsequently revealed that predicted probabilities for all treatment modalities change significantly after 75 years (p < 0.001). Likelihood of surgery-alone and palliative therapies increased for patients aged 75?85yrs but lowered for NACT/NACRT. Performance status divided patients into two clusters which influenced all predicted outcomes in conjunction with age.�ensuremath</pensuremath>ensuremath<pensuremath>Conclusion: XAI techniques delineate the relationship between clinical factors and OC treatment decisions. These techniques identify advanced age as heavily influencing decisions based on our model with a greater role in patients with specific tumour characteristics. This study methodology provides the means for exploring conscious/subconscious bias and interrogating inconsistencies in team-based decision-making within the era of AI-driven decision support.ensuremath</pensuremath>},
note = {For the purpose of open access, the authors have applied a Creative Commons attribution license (CC-BY) to any Author Accepted Manuscript version arising from this submission.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
ensuremath<pensuremath>Background: clinician-led quality control into oncological decision-making is crucial for optimising patient care. Explainable artificial intelligence (XAI) techniques provide data-driven approaches to unravel how clinical variables influence this decision-making. We applied global XAI techniques to examine the impact of key clinical decision-drivers when mapped by a machine learning (ML) model, on the likelihood of receiving different oesophageal cancer (OC) treatment modalities by the multidisciplinary team (MDT).ensuremath</pensuremath>ensuremath<pensuremath>Methods: retrospective analysis of 893 OC patients managed between 2010 and 2022 at our tertiary unit, used a random forests (RF) classifier to predict four possible treatment pathways as determined by the MDT: neoadjuvant chemotherapy followed by surgery (NACT + S), neoadjuvant chemoradiotherapy followed by surgery (NACRT + S), surgery-alone, and palliative management. Variable importance and partial dependence (PD) analyses then examined the influence of targeted high-ranking clinical variables within the ML model on treatment decisions as a surrogate model of the MDT decision-making dynamic.�ensuremath</pensuremath>ensuremath<pensuremath>Results: amongst guideline-variables known to determine treatments, such as Tumour-Node-Metastasis (TNM) staging, age also proved highly important to the RF model (16.1 % of total importance) on variable importance analysis. PD subsequently revealed that predicted probabilities for all treatment modalities change significantly after 75 years (p < 0.001). Likelihood of surgery-alone and palliative therapies increased for patients aged 75?85yrs but lowered for NACT/NACRT. Performance status divided patients into two clusters which influenced all predicted outcomes in conjunction with age.�ensuremath</pensuremath>ensuremath<pensuremath>Conclusion: XAI techniques delineate the relationship between clinical factors and OC treatment decisions. These techniques identify advanced age as heavily influencing decisions based on our model with a greater role in patients with specific tumour characteristics. This study methodology provides the means for exploring conscious/subconscious bias and interrogating inconsistencies in team-based decision-making within the era of AI-driven decision support.ensuremath</pensuremath>
2023
Thavanesan, Navamayooran; Bodala, Indu; Walters, Zoe; Ramchurn, Sarvapali; Underwood, Timothy J.; Vigneswaran, Ganesh
Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer Journal Article
In: European Journal of Surgical Oncology, vol. 49, no. 11, 2023, (Publisher Copyright: © 2023 The Author(s)).
@article{soton479497b,
title = {Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer},
author = {Navamayooran Thavanesan and Indu Bodala and Zoe Walters and Sarvapali Ramchurn and Timothy J. Underwood and Ganesh Vigneswaran},
url = {https://eprints.soton.ac.uk/479497/},
year = {2023},
date = {2023-11-01},
journal = {European Journal of Surgical Oncology},
volume = {49},
number = {11},
abstract = {ensuremath<pensuremath>Background: Rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables. Methods: Retrospective complete-case analysis of oesophagectomy patients $±$ neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model. Results: We identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32?83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [$±$0.045] vs 0.757 [$±$0.068], 0.740 [$±$0.042], and 0.709 [$±$0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p < 0.05). Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future.ensuremath</pensuremath>},
note = {Publisher Copyright:
© 2023 The Author(s)},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
ensuremath<pensuremath>Background: Rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables. Methods: Retrospective complete-case analysis of oesophagectomy patients $±$ neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model. Results: We identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32?83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [$±$0.045] vs 0.757 [$±$0.068], 0.740 [$±$0.042], and 0.709 [$±$0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p < 0.05). Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future.ensuremath</pensuremath>
Thavanesan, Navamayooran; Bodala, Indu; Walters, Zoe; Ramchurn, Sarvapali; Underwood, Timothy J; Vigneswaran, Ganesh
Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer Journal Article
In: European Journal of Surgical Oncology, 2023, (Publisher Copyright: copyright 2023 The Author(s)).
@article{soton479497,
title = {Machine learning to predict curative multidisciplinary team treatment decisions in oesophageal cancer},
author = {Navamayooran Thavanesan and Indu Bodala and Zoe Walters and Sarvapali Ramchurn and Timothy J Underwood and Ganesh Vigneswaran},
url = {https://eprints.soton.ac.uk/479497/},
year = {2023},
date = {2023-07-01},
journal = {European Journal of Surgical Oncology},
abstract = {ensuremath<pensuremath>Background: Rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables. Methods: Retrospective complete-case analysis of oesophagectomy patients $pm$ neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model. Results: We identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32?83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [$pm$0.045] vs 0.757 [$pm$0.068], 0.740 [$pm$0.042], and 0.709 [$pm$0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p < 0.05). Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future.ensuremath</pensuremath>},
note = {Publisher Copyright:
copyright 2023 The Author(s)},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
ensuremath<pensuremath>Background: Rising workflow pressures within the oesophageal cancer (OC) multidisciplinary team (MDT) can lead to variability in decision-making, and health inequality. Machine learning (ML) offers a potential automated data-driven approach to address inconsistency and standardize care. The aim of this experimental pilot study was to develop ML models able to predict curative OC MDT treatment decisions and determine the relative importance of underlying decision-critical variables. Methods: Retrospective complete-case analysis of oesophagectomy patients $pm$ neoadjuvant chemotherapy (NACT) or chemoradiotherapy (NACRT) between 2010 and 2020. Established ML algorithms (Multinomial Logistic regression (MLR), Random Forests (RF), Extreme Gradient Boosting (XGB)) and Decision Tree (DT) were used to train models predicting OC MDT treatment decisions: surgery (S), NACT + S or NACRT + S. Performance metrics included Area Under the Curve (AUC), Accuracy, Kappa, LogLoss, F1 and Precision -Recall AUC. Variable importance was calculated for each model. Results: We identified 399 cases with a male-to-female ratio of 3.6:1 and median age of 66.1yrs (range 32?83). MLR outperformed RF, XGB and DT across performance metrics (mean AUC of 0.793 [$pm$0.045] vs 0.757 [$pm$0.068], 0.740 [$pm$0.042], and 0.709 [$pm$0.021] respectively). Variable importance analysis identified age as a major factor in the decision to offer surgery alone or NACT + S across models (p < 0.05). Conclusions: ML techniques can use limited feature-sets to predict curative UGI MDT treatment decisions. Explainable Artificial Intelligence methods provide insight into decision-critical variables, highlighting underlying subconscious biases in cancer care decision-making. Such models may allow prioritization of caseload, improve efficiency, and offer data-driven decision-assistance to MDTs in the future.ensuremath</pensuremath>
2014
Huynh, Trung Dong; Ebden, Mark; Ramchurn, Sarvapali; Roberts, Stephen; Moreau, Luc
Data quality assessment from provenance graphs Proceedings Article
In: Provenance Analytics 2014, 2014.
@inproceedings{eps365510,
title = {Data quality assessment from provenance graphs},
author = {Trung Dong Huynh and Mark Ebden and Sarvapali Ramchurn and Stephen Roberts and Luc Moreau},
url = {http://eprints.soton.ac.uk/365510/},
year = {2014},
date = {2014-01-01},
booktitle = {Provenance Analytics 2014},
abstract = {Provenance is a domain-independent means to represent what happened in an application, which can help verify data and infer data quality. Provenance patterns can manifest real-world phenomena such as a significant interest in a piece of content, providing an indication of its quality, or even issues such as undesirable interactions within a group of contributors. This paper presents an application-independent methodology for analyzing data based on the network metrics of provenance graphs to learn about such patterns and to relate them to data quality in an automated manner. Validating this method on the provenance records of CollabMap, an online crowdsourcing mapping application, we demonstrated an accuracy level of over 95% for the trust classification of data generated by the crowd therein.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Provenance is a domain-independent means to represent what happened in an application, which can help verify data and infer data quality. Provenance patterns can manifest real-world phenomena such as a significant interest in a piece of content, providing an indication of its quality, or even issues such as undesirable interactions within a group of contributors. This paper presents an application-independent methodology for analyzing data based on the network metrics of provenance graphs to learn about such patterns and to relate them to data quality in an automated manner. Validating this method on the provenance records of CollabMap, an online crowdsourcing mapping application, we demonstrated an accuracy level of over 95% for the trust classification of data generated by the crowd therein.
2011
Osborne, Michael A.; Rogers, Alex; Roberts, Stephen J.; Ramchurn, Sarvapali D.; Jennings, Nicholas R.
Gaussian Processes for Time Series Prediction Book Section
In: Bayesian Time Series Models, pp. 341–360, Cambridge University Press, 2011, (Chapter: 16).
@incollection{eps272746,
title = {Gaussian Processes for Time Series Prediction},
author = {Michael A. Osborne and Alex Rogers and Stephen J. Roberts and Sarvapali D. Ramchurn and Nicholas R. Jennings},
url = {http://eprints.soton.ac.uk/272746/},
year = {2011},
date = {2011-01-01},
booktitle = {Bayesian Time Series Models},
pages = {341–360},
publisher = {Cambridge University Press},
note = {Chapter: 16},
keywords = {},
pubstate = {published},
tppubtype = {incollection}
}