Tapping the pulse of ‘Digital India’: understanding challenges and solutions
‘Digital India’ has emerged among the most discussed phrases in the country. It certainly piqued our interest too. In order to understand the challenges and solutions related to achieving a truly ‘Digital India’, we executed an online study (named India Online Study) in association with India Open Data Association (IODA) and IIM Lucknow. The study, which involved questions allowing free text as a response, received over 2500 responses across India.
Interestingly, this was just not it. To accumulate more data, IODA undertook a 1000 kms.+ road trip recording video interviews of varied respondents. However, this article delves into the techniques deployed to derive insights on the challenges and solutions related to ‘Digital India’ from the responses received.
The steps followed to filter and clean ‘Benefits and Challenges’ related text were, as mentioned below:
- Removal of stop words, punctuation, special characters, and social media symbols.
- Normalising the text (Stemming and Lemmatization).
- Tokenising the corpus (TF-IDF).
- Splitting the responses into sentences.
A Latent Semantic Analysis (LSA) model was applied for analysing the data. It is usually carried out to find the distributional semantics
The steps undertaken were, as follows:
- Applied Singular Value Decomposition(SVD) through Latent Semantic Analysis (LSA) and created 20 topics each for “Benefits” and “Challenges” (considering each sentence as a document).
- For each sentence, identified the appropriate topic based on the scores of the document-topics relation. (Note: Each respondent may belong to multiple topics.)
- Topics were profiled based on the terms of the topic.
Using the identified topics and demographic profile of each respondent, we created Tableau dashboard for easy visualisation and interpretation of the insights derived from the responses. Here is a glimpse of the dashboard:
The insights and analysis served as the base for discussion at the co-creation workshop for chalking out an action plan for achieving a truly ‘Digital India’, conducted by IODA and IIM-L at Fifth PAN IIM World Management Conference 2017