Source: BLUDOT TECHNOLOGIES INC. submitted to
MANAGERIAL SYSTEM FOR RURAL JURISDICTIONS TO INCREASE ECONOMIC DEVELOPMENT CAPACITY
Sponsoring Institution
National Institute of Food and Agriculture
Project Status
TERMINATED
Funding Source
Reporting Frequency
Annual
Accession No.
1025905
Grant No.
2021-33530-34430
Project No.
CALW-2021-01052
Proposal No.
2021-01052
Multistate No.
(N/A)
Program Code
8.6
Project Start Date
Jul 1, 2021
Project End Date
Feb 28, 2022
Grant Year
2021
Project Director
Zheng, S.
Recipient Organization
BLUDOT TECHNOLOGIES INC.
1616 LEE WAY
MILPITAS,CA 950359011
Performing Department
(N/A)
Non Technical Summary
The ability to manage, support, and communicate with local businesses rapidly and effectively has always been a key component of local economic development, and has become exceedingly urgent during the COVID-19 pandemic. Rural jurisdictions are especially faced with the challenges of limited resources, limited capacity, or both. Rural economic development leaders and communities will benefit greatly by having a technology solution that helps maximize their impact in economic recovery.Through this research project, Bludot will partner with approximately forty-three rural communities who will pilot, launch, and utilize the Bludot platform in their respective jurisdictions. Bludot will analyze and evaluate the communities' usage, results, and feedback, which will have an invaluable contribution to advancing Bludot's technology solution for the benefit of all other rural communities in the country.Bludot empowers eachrural economic development staff by giving themthe tools they need to excel at their work. This not only has significant market potential, but immense socioeconomic impact. Findings from this research will directly contribute to a system that will build rural economic development capacity and lead to expansion of businesses, creation of jobs, and overall betterment of rural Americans' quality of life.
Animal Health Component
0%
Research Effort Categories
Basic
20%
Applied
50%
Developmental
30%
Classification

Knowledge Area (KA)Subject of Investigation (SOI)Field of Science (FOS)Percent
60860993100100%
Goals / Objectives
Bludot has identified two main research topicsto analyze, as follows:A. Efficacy of local capacity building, communications, and managerial functionalityWe shall evaluate the impact on capacity building by having a central platform to track engagements with local businesses and collaborate amongst staff. We shall also evaluate the effectiveness of a digital communication platform between local government and businesses, and evaluate the effect on business outreach, business engagement, and retention initiatives. We will study whether having an easy-to-use communication tool enables local economic development leaders to perform more outreach, conduct more targeted campaigns, run more economic development initiatives, and offer more resources. We will also study whether having a user-friendly communication channel empowers businesses to connect with the local government more freely, have more touchpoints, and get more support, hence leading to better retention and expansion results.B. Impact of big data and accessibilityWe shall analyze the impact of getting local business-related data from various external sources and making them easily available to local economic development leaders. We will import any existing data already available at each community, and supplement with the data we source. Additionally, we will examine the impact of tracking data analytics within the platform and provide real-time feedback around business metrics and activity, such as message open rates, sector distribution, and map-based visualization. We will evaluate whether providing this increased accessibility to data can yield increased effectiveness in strategic decision-making at the local level.To fulfillthe above mentioned goals,Bludot has the following four technical objectives that will establish the technical feasibility of the proposed approach.Technical objective 1:To continue to develop, test, and improve Bludot's data algorithms.There are several key data-related processes that will be evaluated.1. Initial onboarding: merging between the community's dataset and the external data we source.Merging requires a method by which we can confidently match the same business record across multiple datasets. In real practice this can be tricky, as one business may have different versions of names (e.g., legal name vs. Doing Business As name) or different spelling (e.g., "Toys for You" vs. "Toys 4 U"). As we test our algorithms using the larger amount of data as part of the SBIR Phase 1 research, we will be able to improve the algorithm' matching efficacy, reduce errors, and handle corner cases.2. Subsequent updates: sync the update files with existing dataset.Businesses in a community are not constant. New businesses open, and some businesses close. Businesses can also move, change owners, open another location, change its name, etc. Thus, periodic updating of the datasets is required. The updating algorithm must be able to (1) identify the discrepancies between the new dataset and existing dataset, (b) identify which changes are due to manual overwrite (e.g., there is an error in the dataset which an user manually corrected via the user interface) vs. valid updates, and (c) perform the updates securely. An error in this algorithm can have significant implications for loss of critical data. Hence, it is critical that this algorithm is thoroughly tested during Phase 1 research before rolling out to a larger scale implementation.3. External data sources: which data sources can we acquire from external sources, and to what extent can it be automated.Leveraging our technical expertise to source data from external sources and make it easily available for communities to use is a core value-add of our platform. We have so far started with Data Axle's database, and through thisproject we will evaluate, test, and enhance processes to acquire data from additional sources systematically.Technical objective 2: To effectively scale, while maintaining product performance, to meet the increased number of communities and increased amount of data.Bludot is deployed on the AWS cloud computing platform. As part of the research, we will evaluate the deployment impact of the increase in scale which will provide critical information for future expansion.Product performance can be measured in various ways, such as response time when you click a button, refresh a page, or send a message. Most actions correlate with a backend data query, which can become slower as datasets increase in size. We will continuously monitor the performance metrics throughout usage of our system and gauge the changes; when impact on performance is detected, we will investigate promptly and devise a solution. These improvements will be foundational to the follow-onexpansion and ultimately large-scale commercialization.Technical objective 3: To enhance the product's user interface such that it can be successfully used by economic development leaders.User experience is key to our platform. If users struggle with any functionality of the system, not only does it waste precious time, it also discourages future usage altogether. Feature design must be tested with real users. Observing how users interact with the system in a real-life situation is one of the most informative and must-have activities. "Observing" does not mean looking over their shoulders; we may "observe" in the background by monitoring user behavior digitally, logging and reviewing any errors, as well as tracking key indicators without interfering with the user's work.Technical objective 4: To identify missing functionalities and their sequence of priorities.Any new product must be used, tried, and tested in the real world in order to reveal its strengths and weaknesses, and ways to improve. Every community that has used our system so far has given us critical feedback relating to product functionality. It is the user feedback that has and will continue to shape the product. Throughout thisresearch project, we will continue to ask this question and listen to communities' feedback to take the system to the next level.
Project Methods
The project will be conducted in the following sequence of stages:1)Community Onboarding and Data ImportFor each participating community, we will gather the available, existing dataset from the community, to whatever extent possible.Then, we will utilize our data processes to source externally available, business-level data for each community. We will leverage our existing data partner Data Axle. We will also identify other potential data sources, evaluate their data content and quality, and if deciding to move forward, implement a systematic process.We will then conduct a merging algorithm between the community's data and the external data we sourced. In this step, we will evaluate the results of the algorithm against the datasets, confirm the quality of the matches including any false positives or false negatives, and readjust the algorithm to optimize results. This will be an iterative process to produce an optimal algorithm that will allow us to perform the most effective comparison and achieve the best results in merging business records.Once the merging algorithm is complete and results optimized, we will import the final merged data into the database and set up the Bludot workspace for each community.Subsequently, we will conduct data updates on a quarterly basis. For each data update, again, we will take any existing data from the local communities as well as external data we source, and run through our update algorithm. We will evaluate the results of the algorithm against the new datasets as well as existing data, confirm the quality of the sync, identify any records that were missed or mis-updated, and readjust the algorithm. An error in this algorithm can have significant implications for loss of critical data. Hence, it is critical that this algorithm is thoroughly tested and results confirmed before rolling out to communities.2) Usage and MonitoringOnce the initial onboarding is complete, local economic development staff may begin using the platform in their respective communities. We will provide training and support as much as needed to each participating staff. Each community shall use the platform to the extent that fits their community and their economic development initiatives. We will maintain a close and collaborative relationship with each of the rural community partners, as we have done with all of our existing community partners. We shall be available to answer any questions, address any issues, and help them implement the tool in a way that best supports their needs.We will monitor the status of the server instances on an ongoing basis as the volume of data and user queries grow. Any worsening indicator will be reviewed immediately. Any changes required to maintain the optimal performance and ensure application uptime will be addressed in the highest priority.We will also regularly monitor the performance metrics/KPIs as users interact with the platform. If we observe any excessively lengthened processing times, it will be reviewed immediately and the appropriate action taken. Any errors or exceptions thrown within the platform will also be tracked. If it is something that a user is experiencing on their end, we may conduct a virtual tech support session to assist and evaluate remotely.3) Evaluation and FeedbackAs our rural government partners use the platform in their communities, we will actively seek their feedback on what they like, don't like, or find missing in the tool. As this task is more qualitative in nature, it will rely on direct engagements with each community. Communities shall feel free to provide feedback at any time; if not, we shall proactively check in at least once a month.For each suggestion we receive, if it is a quick fix, we may roll out the fix relatively quickly, within a few days. If it is a more extensive feature development, we will evaluate its priority against our existing development roadmap and plan accordingly. Throughout this process, we will remain agile as we have been, and diligently listen and respond to our users' feedback.Each time we release a fix or a new feature to the platform, all partner jurisdictions will access the latest version instantaneously, upon which we will continue to monitor their usage, gather feedback on the new version, and continue making improvements, hence making this an iterative process.Through our own evaluation as well as user's direct feedback, we will identify the areas where users may find hard to use. We may involve the user in our redesign process to ensure that we find the best way to address their requirements. Once we make the improvements per our process described above, we will be able to gather feedback again from this user as well as other users and confirm that the fix has worked and the issue resolved.As is the case with our existing community partners, their feedback often suggests a functionality that we don't have yet. With the communities' help, we may identify their relative importance from nice-to-have to must-have. The functionalities that can be delivered within the duration of this project period will again go through the iterative process and gather more feedback as communities put it to use.4) Final Project ConclusionIn the final month of the project, we shall focus on the final project conclusion, and consolidate all the findings we have gathered to answer the following two research priorities, as previously identified:A. Efficacy of local capacity building, communications, and managerial functionalityWe will conduct quantitative as well as qualitative analysis to address this question. Quantitatively, Bludot will examine its back-end data, such as staff usage, communications sent, communications open rates, and local businesses' engagements.Qualitatively, Bludot will perform at least 10 comprehensive interviews with communities' users. We will capture any short-term strategies that local economic development leaders used to meet their businesses needs and/or any success strategies of retention or expansion.B. Impact of big data and accessibilityThis research priority will also be addressed via both quantitative and qualitative analysis.Quantitatively, Bludot will be able to gauge via back-end data how much has Bludot sourced data played role in the community's usage. This could be being used as an identifier in an outreach, in a map-based analysis, or in a dashboard chart, to name a few. If a significant percentage of usage can be attributed to the availability of Bludot sourced data, then it is a strong indicator of its value.Qualitatively, Bludot will also include questions in the final interview around how much the data has, or has not, empowered the community's economic development initiatives. Again, open discussion is encouraged to offer reasoning and examples as to why or why not.The last piece of data point would be how many of the communities decide to retain the tool at the conclusion of this project. This will be a strong indicator of whether the Bludot solution meets a significantly enough need and delivers significantly enough impact that communities are willing to invest.

Progress 07/01/21 to 02/28/22

Outputs
Target Audience:Bludot's primary target audience include small-mid sized cities and counties in the country. Our target customers include local government staff, local/regional economic development organizations (EDOs), chambers of commerce, etc. Small to midsized jurisdictions face capacity constraints most acutely and hence is where the Bludot solution provides significant value. Changes/Problems: Nothing Reported What opportunities for training and professional development has the project provided?PI Sophia Zheng attended the following conferences:IEDC (International Economic Development Council) annual conference, MidAmerica Economic Development Council annual conference,Kentucky Association for Economic Development annual conference. How have the results been disseminated to communities of interest?We have had monthly check-ins with our participating rural communities and our progress including new features and enhancements have been communicated to the rural communities as they become available throughout Phase I. What do you plan to do during the next reporting period to accomplish the goals? Nothing Reported

Impacts
What was accomplished under these goals? Rural economic development is a critical element of rural communities' prosperity. However, the ability to conduct and practice economic development activities within rural communities is often constricted by lack of capacity, lack of resources, or both. The purpose of Bludot's Phase I project is to further the research and development of our managerial solution, with the goal to improve the efficiency and effectiveness of local economic development, build capacity, and maximize impact in rural communities. During the Phase I project, Bludot successfully onboarded 41 rural communities and organizations across the country, withover 40,000 businesses collectively. The level of representation exceeded the original goal. With the Phase I funding, the participating rural communities were able to fully utilize the functionalities and data and provide valuable insights. During the study period, over 4,000 touchpoints have been tracked between the economic development staff and local businesses. The communities reported increased efficiency in supporting local businesses, better organizational and process management, and more data-driven decision-making. The rural communities' feedback have led to substantial enhancements in product functionalities, usability, cloud infrastructure, and data algorithms, laying a solid foundation for expansion. Ultimately, this Phase I project has furthered the research and development of a much-needed software solution that leads to expansion of businesses, creation of jobs, and overall betterment of rural Americans' quality of life. Technical objective 1: To continue to develop, test, and improve Bludot's data algorithms. 1) Major activities completed Initial onboarding: For each community, we accepted any existing data from the communities and supplemented with the external data we source. Subsequent updates: We tested a quarterly update sequence to update the dataset with our externally sourced data. When applicable, we also performed updates with community-provided data. External data sources: We continued to implement our data integration with Data Axle's APIs. In addition, we also investigated other data sources beyond Data Axle. 2) Data collected and discussion of results 1. Initial onboarding: Key enhancements made include: Increase the matching similarity confidence threshold from 0.5 to 0.7. Eliminate required fields as much as possible, such as zip codes. Label businesses that were from the community's dataset vs the external data we source. Add a manual merging user interface. 2. Subsequent updates: Based on learnings from Phase I, the following enhancements have been made: Change the database structure to allow tracking of both default values and user overwrites. Where applicable, convert system labels to dynamic labels. Streamline the data updating procedure. 3. External data sources: In addition to Data Axle, the other data sources we investigated include: Use Google Maps API to get the zipcodes and geocodes. Use Google Places API to query additional information about each business. Use hunter.io to gather business contact email addresses. 3) Key outcomes Our research during Phase I has enabled us to change and enhance our technical processes for gathering and processing local business data. These technical processes have been implemented in production. Making data accessible to rural communities has proven to be a significant change-maker by empowering the users to integrate data in their decision making and planning in a way that was not previously possible, thus createing a change in their local societal condition. Technical objective 2: To effectively scale, while maintaining product performance, to meet the increased number of communities and increased amount of data. 1) Major activities completed As part of Phase I, we evaluated the AWS deployment impact of the increase in scale. We closely monitored product performance as we added more users and more data. Metrics included UI response times, error logs, CPU spikes, etc. 2) Data collected and discussion of results During Phase I, we were able to successfully upgrade our AWS architecture to a more robust and scalable setup. Key enhancements made include: 1. Fargate ECS Cluster - (Deprecated all EC2 instances) ECS service for Web Requests - Enabled Automatic Horizontal scaling based on number of requests ECS services for background jobs/workers - Enabled Automatic Horizontal scaling based on CPU/Memory utilization 2. AWS Opensearch (aka Elasticsearch) Increased CPU and Storage across the nodes Changed cluster node's instance type for better performance 3. RDS (Database) Increased CPU & changed instance type for better performance 4. VPN (Virtual Private Network) Upgraded VPN settings for multi-region support 3) Key outcomes Our work in Phase I directly resulted in an improved and more robust cloud architecture that lays a strong foundation for further commercial expansion. Another major accomplishment is that Bludot was also accepted to AWS Govtech Start program. Technical objective 3: To enhance the product's user interface such that it can be successfully used by economic development leaders. 1) Major activities completed During Phase I, we have measured usage data and gathered user feedback. Their feedback have been incorporated into product designs and roadmap. Further, we have set up processes to monitor and gather user feedback at scale, including LogRocket and Mixpanel. 2) Data collected and discussion of results Notable UI enhancements made during Phase I include: Improved group email design to be more intuitive Improved email connection interface, allowing users to select from a few varying levels of integration Let users track the read and unread status for group post recipients Let users add, edit, and delete a GIS shapefile Let users add notes and documents to a business profile Enhancements to Advanced Search options 3) Key outcomes or other accomplishments realized The feedback and user metrics that we have gathered during Phase I have directly led to enhancements in our product features, usability, and effectiveness. These changes are now live in production and being used by all of our users. Further, these enhancements empower our users to better reach their economic development goals and better support their local businesses, thus creating a positive change in the local societal condition. Technical objective 4: To identify missing functionalities and their sequence of priorities. 1) Major activities completed Throughout Phase I, we have continued to listen to our rural communities for suggestions on new features. These suggestions have been collected in a central feature request log and incorporated into our product roadmap. 2) Data collected and discussion of results Notable new features that we have released during Phase I include: A new enhanced dashboard with guided access that lets users track their engagements more easily A new custom reporting interface to build any reports that users need Dynamic labels functionality based on search queries Changed email tracking to threads instead of individual emails to improve syncing speed and performance Improved business contacts section to allow more flexibility in entering complex contact details for a business Notable features for our upcoming roadmap include: Add project tracking capabilities Introduce concept of custom activities on the wall Add calendar integration Expand survey functionality to allow generic forms Enhance dashboard with more charts and allow drilldown Allow setting of user permissions 3) Key outcomes The suggestions and requests from our users during Phase I have directly led to enhancements in our product features, usability, and effectiveness. Further, our participating rural communities all reported increase of their economic development capacity, confirming the positive impact of this technology platform.

Publications


    Progress 07/01/21 to 02/28/22

    Outputs
    Target Audience:Bludot's primary target audience includesmall-mid sized cities and counties in the country. Our target customers include local government staff, local/regional economic development organizations (EDOs), chambers of commerce, etc. Small to midsized jurisdictions face capacity constraints most acutely and hence is where the Bludot solution provides significant value. Changes/Problems: Nothing Reported What opportunities for training and professional development has the project provided? Nothing Reported How have the results been disseminated to communities of interest?We have had monthly check-ins with our participating rural communitiesand our progress including new features and enhancements have been communicated to the rural communities as they become available throughout Phase I. What do you plan to do during the next reporting period to accomplish the goals? Nothing Reported

    Impacts
    What was accomplished under these goals? Rural economic development is a critical element of rural communities' prosperity. However, the ability to conduct and practice economic development activities within rural communities is often constricted by lack of capacity, lack of resources, or both. The purpose of Bludot's Phase I project is to further the research and development of our managerial solution, with the goal to improve the efficiency and effectiveness of local economic development, build capacity, and maximize impact in rural communities. During the Phase I project, Bludot successfully onboarded 41 rural communities and organizations across the country, with over 40,000 businesses collectively. Thelevel of representation exceeded the original goal. With the Phase I funding, the participating rural communities were able to fully utilizethe functionalities and dataand providevaluable insights.During the study period, over 4,000 touchpoints have been tracked between the economic development staff and local businesses. The communities reported increased efficiency in supporting local businesses, better organizational and process management, and more data-driven decision-making. The rural communities' feedback have led to substantial enhancements in product functionalities, usability, cloud infrastructure, and data algorithms, laying a solid foundation for expansion. Ultimately, this Phase I project has furthered the research and development of a much-needed software solution that leads to expansion of businesses, creation of jobs, and overall betterment of rural Americans' quality of life. Technical objective 1: To continue to develop, test, and improve Bludot's data algorithms. 1) Major activities completed Initial onboarding:For each community, we accepted any existing data from the communities and supplemented with the external data we source. Subsequent updates:We tested a quarterly update sequence to update the dataset with our externally sourced data. When applicable, we also performed updates with community-provided data. External data sources:We continued to implement our data integration with Data Axle's APIs. In addition, we also investigated other data sources beyond Data Axle. 2) Data collected and discussion of results Initial onboarding: Key enhancements made include: Increase the matching similarity confidence threshold from 0.5 to 0.7. Eliminate required fields as much as possible, such as zip codes. Label businesses that were from the community's dataset vs the external data we source. Add a manual merging user interface. Subsequent updates: Based on learnings from Phase I, the following enhancements have been made: Change the database structure to allow tracking of both default values and user overwrites. Where applicable, convert system labels to dynamic labels. Streamline the data updating procedure. External data sources:In addition to Data Axle, the other data sources we investigated include: Use Google Maps API to get the zipcodes and geocodes per businesses' addresses. Use Google Places API to query additional information about each business. Use hunter.io to gather business contact email addresses. 3) Key outcomes Our research during Phase I has enabled us to change and enhance our technical processes for gathering and processing local business data. These technical processes have been implemented in production.Making data accessible to rural communities has proven to be a significant change-maker by empowering the users to integrate data in their decision making and planning in a way that was not previously possible, thus createing a change in their local societal condition. Technical objective 2: To effectively scale, while maintaining product performance, to meet the increased number of communities and increased amount of data. 1) Major activities completed As part of Phase I, we evaluated the AWS deployment impact of the increase in scale. We closely monitored product performance as we added more users and more data. Metrics included UI response times, error logs, CPU spikes, etc. 2) Data collected and discussion of results During Phase I, we were able to successfully upgrade our AWS architecture to a more robust and scalable setup. Key enhancements made include: Fargate ECS Cluster - (Deprecated all EC2 instances) ECS service for Web Requests - Enabled Automatic Horizontal scaling based on number of requests ECS services for background jobs/workers - Enabled Automatic Horizontal scaling based on CPU/Memory utilization AWS Opensearch (aka Elasticsearch) Increased CPU and Storage across the nodes Changed cluster node's instance type for better performance RDS (Database) Increased CPU & changed instance type for better performance VPN (Virtual Private Network) Upgraded VPN settings for multi-region support 3) Key outcomes Our work in Phase I directly resulted in an improved and more robust cloud architecture that lays a strong foundation for further commercial expansion. Another major accomplishment is that Bludot was also accepted to AWS Govtech Start program. Technical objective 3: To enhance the product's user interface such that it can be successfully used by economic development leaders. 1) Major activities completed During Phase I, we have measured usage data and gathered user feedback. Their feedback have been incorporated into product designs and roadmap. Further, we have set up processes to monitor and gather user feedback at scale, including LogRocket andMixpanel. 2) Data collected and discussion of results Notable UI enhancements made during Phase I include: Improved group email design to be more intuitive Improved email connection interface, allowing users to select from a few varying levels of integration Let users track the read and unread status for group post recipients Let users add, edit, and delete a GIS shapefile Let users add notes and documents to a business profile Enhancements to Advanced Search options 3) Key outcomes or other accomplishments realized The feedback and user metrics that we have gathered during Phase I have directly led to enhancements in our product features, usability, and effectiveness. These changes are now live in production and being used by all of our users. Further, these enhancementsempowerour users to better reach their economic development goals and better support their local businesses, thus creating a positive change in the local societal condition. Technical objective 4: To identify missing functionalities and their sequence of priorities. 1) Major activities completed Throughout Phase I, we have continued to listen to our rural communities for suggestions on new features. These suggestions have been collected in a central feature request log and incorporated into our product roadmap. 2) Data collected and discussion of results Notable new features that we have released during Phase I include: A new enhanced dashboard with guided access that lets users track their engagements more easily A new custom reporting interface to build any reports that users need Dynamic labels functionality based on search queries Changed email tracking to threads instead of individual emails to improve syncing speed and performance Improved business contacts section to allow more flexibility in entering complex contact details for a business Notable features for our upcoming roadmap include: Add project tracking capabilities Introduce concept of custom activities on the wall Add calendar integration Expand survey functionality to allow generic forms Enhance dashboard with more charts and allow drilldown Allow setting of user permissions 3) Key outcomes The suggestions and requests from our users during Phase I have directly led to enhancements in our product features, usability, and effectiveness. Further, our participating rural communities all reported increase of their economic development capacity, confirming the positive impact of this technologyplatform.

    Publications