{"id":19992,"date":"2024-04-04T10:23:48","date_gmt":"2024-04-04T10:23:48","guid":{"rendered":"https:\/\/quentinlengele.com\/?p=19992"},"modified":"2025-11-06T08:46:58","modified_gmt":"2025-11-06T08:46:58","slug":"qfxdiffusion","status":"publish","type":"post","link":"https:\/\/quentinlengele.com\/index.php\/2024\/04\/04\/qfxdiffusion\/","title":{"rendered":"QFX Diffusion"},"content":{"rendered":"<p dir=\"auto\">I recently built a <strong data-start=\"156\" data-end=\"201\">Stable Diffusion plugin for Unreal Engine<\/strong> that lets you render scenes <strong data-start=\"230\" data-end=\"262\">directly inside the viewport<\/strong>.<\/p>\n<p dir=\"auto\"><!--more--><\/p>\n<div>The tool captures the <strong data-start=\"286\" data-end=\"299\">depth map<\/strong> of the scene and feeds it into <strong data-start=\"331\" data-end=\"351\">Stable Diffusion<\/strong> to generate a new image effectively blending real-time 3D rendering with it.<\/div>\n<div>I first put this tool to use with a <strong data-start=\"119\" data-end=\"142\">real estate company<\/strong> to generate high-quality <strong data-start=\"168\" data-end=\"188\">interior visuals<\/strong>. By training a <strong data-start=\"204\" data-end=\"237\">custom Stable Diffusion model<\/strong> on a curated set of the company\u2019s own interior photos, the plugin was able to produce renders that <strong data-start=\"337\" data-end=\"389\">matched their specific design style and branding<\/strong>. This approach allowed for rapid iteration and stylistic consistency, transforming Unreal Engine viewports into a powerful concept visualization tool for architectural and interior design.<\/div>\n<p>&nbsp;<\/p>\n<div style=\"padding: 56.25% 0 0 0; position: relative;\"><iframe style=\"position: absolute; top: 0; left: 0; width: 100%; height: 100%;\" title=\"SD Renderer Plugin for UE5, Preview 1\" src=\"https:\/\/player.vimeo.com\/video\/929497321?h=bb850a2be1&amp;badge=0&amp;autopause=0&amp;player_id=0&amp;app_id=58479\" frameborder=\"0\"><\/iframe><\/div>\n<p>&nbsp;<\/p>\n<h2>TRAINED MODEL<\/h2>\n<div>I also experimented with a more <strong data-start=\"78\" data-end=\"98\">personal project<\/strong>, training a Stable Diffusion model using photos of my friend <strong data-start=\"160\" data-end=\"176\">Alexandre W. <\/strong>(with his full consent).<\/div>\n<div>Using a <strong data-start=\"209\" data-end=\"255\">mannequin character in the Unreal viewport<\/strong>, I was able to place him in a variety of imagined scenarios and generate AI-enhanced renders. This workflow allowed me to explore <strong data-start=\"386\" data-end=\"416\">creative scene composition<\/strong> while combining Unreal\u2019s real-time capabilities with the flexibility of a custom-trained diffusion model.<\/div>\n<p>&nbsp;<\/p>\n<div style=\"padding: 56.25% 0 0 0; position: relative;\"><iframe style=\"position: absolute; top: 0; left: 0; width: 100%; height: 100%;\" title=\"SD Renderer Plugin for UE5, Preview 2\" src=\"https:\/\/player.vimeo.com\/video\/929601884?h=4d213f2ba2&amp;badge=0&amp;autopause=0&amp;player_id=0&amp;app_id=58479\" frameborder=\"0\"><\/iframe><\/div>\n<p>&nbsp;<\/p>\n<h2>Equirectangular Render<\/h2>\n<p>I\u2019ve just added a new feature to the plugin. You can now render <strong data-start=\"182\" data-end=\"206\">360\u00b0 panoramic shots<\/strong> of your current scene as <strong data-start=\"232\" data-end=\"256\">equirectangular maps<\/strong>.<\/p>\n<p>This means you can step right inside your AI-generated environments and freely look around, giving you a fully immersive view of your creation. It\u2019s a great way to explore lighting, composition, and mood from every angle.<\/p>\n<p>Next: I\u2019ll be diving into <strong data-start=\"521\" data-end=\"543\">Gaussian Splatting<\/strong> to turn these renders into <strong data-start=\"583\" data-end=\"611\" data-is-only-node=\"\">fully textured 3D scenes<\/strong>.<\/p>\n<div style=\"padding: 56.25% 0 0 0; position: relative;\"><iframe style=\"position: absolute; top: 0; left: 0; width: 100%; height: 100%;\" title=\"QFX Diffusion - 360\u00b0 AI Render\" src=\"https:\/\/player.vimeo.com\/video\/1133797947?h=87ea74fa59&amp;badge=0&amp;autopause=0&amp;player_id=0&amp;app_id=58479\" frameborder=\"0\"><\/iframe><\/div>\n<p><script src=\"https:\/\/player.vimeo.com\/api\/player.js\"><\/script><\/p>\n","protected":false},"excerpt":{"rendered":"<p>I recently built a Stable Diffusion plugin for Unreal Engine that lets you render scenes directly inside the viewport.<\/p>\n","protected":false},"author":1,"featured_media":20171,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[18,7,22,23],"tags":[],"class_list":["post-19992","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-c","category-gpu","category-python","category-unreal"],"_links":{"self":[{"href":"https:\/\/quentinlengele.com\/index.php\/wp-json\/wp\/v2\/posts\/19992","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/quentinlengele.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/quentinlengele.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/quentinlengele.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/quentinlengele.com\/index.php\/wp-json\/wp\/v2\/comments?post=19992"}],"version-history":[{"count":9,"href":"https:\/\/quentinlengele.com\/index.php\/wp-json\/wp\/v2\/posts\/19992\/revisions"}],"predecessor-version":[{"id":20173,"href":"https:\/\/quentinlengele.com\/index.php\/wp-json\/wp\/v2\/posts\/19992\/revisions\/20173"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/quentinlengele.com\/index.php\/wp-json\/wp\/v2\/media\/20171"}],"wp:attachment":[{"href":"https:\/\/quentinlengele.com\/index.php\/wp-json\/wp\/v2\/media?parent=19992"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/quentinlengele.com\/index.php\/wp-json\/wp\/v2\/categories?post=19992"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/quentinlengele.com\/index.php\/wp-json\/wp\/v2\/tags?post=19992"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}