Clustering criteria

Dasgupta's objective

In the study of hierarchical clustering, Dasgupta's objective is a measure of the quality of a clustering, defined from a similarity measure on the elements to be clustered. It is named after Sanjoy Dasgupta, who formulated it in 2016. Its key property is that, when the similarity comes from an ultrametric space, the optimal clustering for this quality measure follows the underlying structure of the ultrametric space. In this sense, clustering methods that produce good clusterings for this objective can be expected to approximate the ground truth underlying the given similarity measure. In Dasgupta's formulation, the input to a clustering problem consists of similarity scores between certain pairs of elements, represented as an undirected graph , with the elements as its vertices and with non-negative real weights on its edges. Large weights indicate elements that should be considered more similar to each other, while small weights or missing edges indicate pairs of elements that are not similar. A hierarchical clustering can be described as a tree (not necessarily a binary tree) whose leaves are the elements to be clustered; the clusters are then the subsets of elements descending from each tree node, and the size of any cluster is its number of elements. For each edge of the input graph, let denote the weight of edge and let denote the smallest cluster of a given clustering that contains both and . Then Dasgupta defines the cost of a clustering to be The optimal clustering for this objective is NP-hard to find. However, it is possible to find a clustering that approximates the minimum value of the objective in polynomial time by a divisive (top-down) clustering algorithm that repeatedly subdivides the elements using an approximation algorithm for the sparsest cut problem, the problem of finding a partition that minimizes the ratio of the total weight of cut edges to the total number of cut pairs.Equivalently, for purposes of approximation, one may minimize the ratio of the total weight of cut edges to the number of elements on the smaller side of the cut. Using the best known approximation for the sparsest cut problem, the approximation ratio of this approach is . (Wikipedia).

Video thumbnail

Ban Ki-Moon: United Nations Secretary General

Ban Ki-Moon, United Nations Secretary General, explains the important role women can play in the effort to address global challenges. This video is part of the Yale Global Perspectives series. To learn more about this series, visit http://world.yale.edu.

From playlist Global Perspectives

Video thumbnail

Raja Harishchandra- 1913- India's First Silent Film- FULL FOOTAGE

Raja Harishchandra is a 1913 silent Indian film directed and produced by Dadasaheb Phalke, and is the first full-length Indian feature film

From playlist Hindi Movies

Video thumbnail

Join my wife and me on the 1st day of our Diwali

Join my wife and me on the 1st day of our Diwali

From playlist India

Video thumbnail

Kesang Tseten on Documentary Film

In this video, filmmaker and writer Kesang Tseten discusses his film, Who Will Be A Gurkha?, a documentary about Nepali Gurkhas who have been recruited into the British military for decades. Tseten's documentaries have won several awards in film festivals in Nepal and been screened at inte

From playlist Yale Himalaya Initiative

Video thumbnail

This Circle Is Mine (Short)

'This Circle is Mine' is a short documentation of a day in the life of Krishnadas, a man who stands everyday for hours on end at Juhu Circle in Mumbai with a sign that says 'Apne dharm par chalo, sabse prem karo (Follow your religion, love everybody)'. The film documents various aspects of

From playlist Amazing Stuff

Video thumbnail

David Attenborough and Venki Ramakrishnan on the Dasgupta Review | The Royal Society

Sir David Attenborough joins economist Professor Sir Partha Dasgupta and Nobel-prize winning biologist Sir Venki Ramakrishnan to mark the publication of The Economics of Biodiversity: The Dasgupta Review. #Dasgupta #DavidAttenborough #health #Ecosystems #Biodiversity #Nature #economics #N

From playlist Popular talks and lectures

Video thumbnail

Pt. Nikhil Banerjee - Raag Jaunpuri

Pt. Nikhil Banerjee - Raag Jaunpuri from the album 'Jaunpuri and Mand'

From playlist Raag Jaunpuri

Video thumbnail

Mod-03 Lec-05 The Samkhya Philosophy - I

Indian Philosophy by Dr. Satya Sundar Sethy, Department of Humanities and Social Sciences, IIT Madras. For more details on NPTEL visit http://nptel.iitm.ac.in

From playlist IIT Madras: Introduction to Indian Philosophy | CosmoLearning.org Philosophy

Video thumbnail

The Impossible Dream of Neutrino Astronomy by Basu Dasgupta

COSMIC ZOOM THE IMPOSSIBLE DREAM OF NEUTRINO ASTRONOMY SPEAKER: Basu Dasgupta (Theoretical Physicist, TIFR ) DATE: 09 April 2021, 19:00 to 20:30 VENUE: Online Abstract: Neutrinos are unique: almost massless, barely interacting, and capable of preserving quantum coherence over macrosco

From playlist Cosmic Zoom

Video thumbnail

Ashani Dasgupta: Local Connectedness of Boundaries for Relatively Hyperbolic Groups

Ashani Dasgupta, University of Wisconsin-Milwaukee Title: Local Connectedness of Boundaries for Relatively Hyperbolic Groups Let $(\Gamma,\mathbb{P})$ be a relatively hyperbolic group pair that is relatively one ended. Then the Bowditch boundary of $(\Gamma,\mathbb{P})$ is locally connect

From playlist 39th Annual Geometric Topology Workshop (Online), June 6-8, 2022

Video thumbnail

David Rolnick & Ishita Dasgupta: Modeling Dynamic Memory with Hopfield Networks

MIT RES.9-003 Brains, Minds and Machines Summer Course, Summer 2015 View the complete course: https://ocw.mit.edu/RES-9-003SU15 Instructor: David Rolnick, Ishita Dasgupta David Rolnick and Ishita Dasgupta explore how Hopfield networks, commonly used to model static memories, can be extend

From playlist MIT RES.9-003 Brains, Minds and Machines Summer Course, Summer 2015

Video thumbnail

Planning for future meetings by Jyotishman Dasgupta

Modern Trends in Electron Transfer Chemistry: From Molecular Electronics to Devices URL: https://www.icts.res.in/discussion-meeting/MTETC2016 DATES: Thursday 28 Jan, 2016 - Friday 29 Jan, 2016 VENUE : Madhava Lecture Hall, ICTS Bangalore DESCRIPTION: The meeting aims to introduce stud

From playlist Modern Trends in Electron Transfer Chemistry: From Molecular Electronics to Devices

Video thumbnail

Mod-04 Lec-11 The Yoga Philosophy - I

Indian Philosophy by Dr. Satya Sundar Sethy, Department of Humanities and Social Sciences, IIT Madras. For more details on NPTEL visit http://nptel.iitm.ac.in

From playlist IIT Madras: Introduction to Indian Philosophy | CosmoLearning.org Philosophy

Video thumbnail

Spin Glasses and Related Systems (Lecture 2) by Chandan Dasgupta

PROGRAM: BANGALORE SCHOOL ON STATISTICAL PHYSICS - XIII (HYBRID) ORGANIZERS: Abhishek Dhar (ICTS-TIFR, India) and Sanjib Sabhapandit (RRI, India) DATE & TIME: 11 July 2022 to 22 July 2022 VENUE: Madhava Lecture Hall and Online This school is the thirteenth in the series. The schoo

From playlist Bangalore School on Statistical Physics - XIII - 2022 (Live Streamed)

Video thumbnail

Spin Glasses and Related Systems (Lecture 4) by Chandan Dasgupta

PROGRAM: BANGALORE SCHOOL ON STATISTICAL PHYSICS - XIII (HYBRID) ORGANIZERS: Abhishek Dhar (ICTS-TIFR, India) and Sanjib Sabhapandit (RRI, India) DATE & TIME: 11 July 2022 to 22 July 2022 VENUE: Madhava Lecture Hall and Online This school is the thirteenth in the series. The schoo

From playlist Bangalore School on Statistical Physics - XIII - 2022 (Live Streamed)

Video thumbnail

Dipole Alignment of Water Molecules Flowing Through a Carbon... by Chandan Dasgupta

DISCUSSION MEETING STATISTICAL PHYSICS: RECENT ADVANCES AND FUTURE DIRECTIONS (ONLINE) ORGANIZERS: Sakuntala Chatterjee (SNBNCBS, Kolkata), Kavita Jain (JNCASR, Bangalore) and Tridib Sadhu (TIFR, Mumbai) DATE: 14 February 2022 to 15 February 2022 VENUE: Online In the past few dec

From playlist Statistical Physics: Recent advances and Future directions (ONLINE) 2022

Video thumbnail

Here’s How That Annoying Fly Dodges Your Swatter | Deep Look

A fly has a pair of tiny, dumbbell-shaped limbs called halteres that were once a second pair of wings. They wield them to make razor-sharp turns and land out of reach on your ceiling. But don't despair – there *is* a trick to smacking these infuriating insects. SUBSCRIBE to Deep Look! ht

From playlist Deep Look | Series | KQED

Video thumbnail

Understanding DevOps | What is DevOps?

DevOps is a widely used term, but people interpret it differently. What does it mean and what does it really take to implement DevOps and Continuous Delivery? Ideas like DevOps Pipelines (Deployment Pipelines) implementing the core technical practices of Continuous Delivery, Continuous Dep

From playlist DevOps

Video thumbnail

Generative Models for Networks (Lecture 3) by Anirban Dasgupta

Program Summer Research Program on Dynamics of Complex Systems ORGANIZERS: Amit Apte, Soumitro Banerjee, Pranay Goel, Partha Guha, Neelima Gupte, Govindan Rangarajan and Somdatta Sinha DATE : 15 May 2019 to 12 July 2019 VENUE : Madhava hall for Summer School & Ramanujan hall f

From playlist Summer Research Program On Dynamics Of Complex Systems 2019

Video thumbnail

Mahatma Gandhi And The Indian Anti-Colonial Resistance After WW1 I THE GREAT WAR 1921

Sign up for Curiosity Stream and get Nebula bundled in and SAVE 41%: https://curiositystream.com/thegreatwar Mohandas Karamchand Gandhi was no stranger to anti-colonial activism when he returned to India during the First World War. After the great sacrifices of Britain's colony, the deman

From playlist The Great War - 1921

Related pages

Approximation algorithm | Similarity measure | Hierarchical clustering | Ultrametric space