We are moving to the co-pilot era..
Copilots for work
Microsoft have also set out their immediate plans:
“In addition, the following new capabilities will be added to Microsoft 365 Copilot and Microsoft Viva:
Copilot in Whiteboard will make Microsoft Teams meetings and brainstorms more creative and effective. Using natural language, you can ask Copilot to generate ideas, organize ideas into themes, create designs that bring ideas to life, and summarize Whiteboard content.
By integrating DALL-E, OpenAI’s image generator, into Copilot in PowerPoint, users will be able to ask Copilot to create custom images to support their content.
Copilot in Outlook will offer coaching tips and suggestions on clarity, sentiment and tone to help users write more effective emails and communicate more confidently.
Copilot in OneNote will use prompts to draft plans, generate ideas, create lists and organize information to help customers find what they need easily.
Copilot in Viva Learning will use a natural language chat interface to help users create a personalized learning journey including designing upskilling paths, discovering relevant learning resources and scheduling time for assigned trainings.
To help every customer get AI-ready, Microsoft is also introducing the Semantic Index for Copilot, a new capability we’re starting to roll out to all Microsoft 365 E3 and E5 customers.” [link]
Given the podcast audio file, the Whisper model performs speech-to-text to generate a transcript of the podcast.
Given this transcript, the Dolly 2 model extracts the name of the guest on the podcast.
Given the guest name, the Bing Search Grounding API retrieves a bio for the guest from the internet.
Given the transcript and guest’s bio, the GPT-4 model generates a social media post promoting the podcast episode.
Given the social media post, we use GPT-4 to create a relevant DALL-E prompt.
Given that DALL-E prompt, the DALL-E model generates a corresponding image for the post.
Finally, the user has an opportunity to review the content before posting, and if approved, a LinkedIn plugin will post the social media copy and image to LinkedIn.
Copilot integration with Power BI!!
Copilot in Power BI is an AI-powered feature that helps users uncover and share insights faster. Here are some awesome features of Copilot in Power BI:
1. Advanced Generative AI: Copilot combines advanced generative AI with your data, enabling it to generate insights that may not be immediately apparent to users.
2. Natural Language Questions: Copilot allows users to ask natural language questions about their data, making it easier to get insights from the data.
3. Stunning Visuals: Copilot helps users create stunning visuals quickly and easily, making it easier to analyze data and share insights.
4. Conversational Experience: Copilot offers an open-ended and conversational experience while building Flows, allowing users to ask questions and get instant feedback.
5. Enhanced App Building: Copilot promises to enhance app building and flow generation, making it easier and faster to build apps and workflows.Overall, Copilot in Power BI is an exciting feature that promises to revolutionize the way users interact with their data. By combining advanced generative AI with natural language questions and stunning visuals, Copilot makes it easier to uncover insights and share them with others.
But now comes a question on “How will Copilot impact the role of Power BI consultants”
With the introduction of Copilot’s natural language query feature, report building may become more accessible to business users, reducing the need for highly skilled Power BI consultants.
The impact of Copilot on the role of Power BI consultants is still uncertain, but it may present both challenges and opportunities for consultants to adapt and grow their skills. [link]
Coding copilot
How GitHub Copilot is getting better at understanding your code
With a new Fill-in-the-Middle paradigm, GitHub engineers improved the way GitHub Copilot contextualizes your code. By continuing to develop and test advanced retrieval algorithms, they’re working on making our AI tool even more advanced.
Copilots in a web..
It’s built on GPT4, the same LLM behind ChatGPT. Based on my examples, it gives more personalized, in-depth answers.
It does this using Copilot:
-It understands your initial query
-Asks you reclarifying questions
-Searches the real-time web
-Provides richer answers with citations
We are thrilled to announce that the Photoshop (beta) app has released Generative Fill, the world’s first co-pilot in creative and design workflows, giving users a magical new way to work.
Finally: You get a copilot and you get a copilot..
State of GPT // Andrej Karpathy
