-
Notifications
You must be signed in to change notification settings - Fork 2.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Build a combined Track and Submit flow on the FE, so we can use it to run our very first A/B test. #47598
Comments
That looks good to me :) |
I can help move this forward - will assign for now to track but need a bit more context |
@anmurali @danielrvidal |
Yeah that works @anmurali. Do we have a doc or something this links to so I can get more context? Is the A test just the current FAB/Global Create menu? |
I pushed a PR for the beta. Can I get confirmation that this is ready to be built so I can get one of our external agencies on it? |
I wrote up a problem/ hypothesis/ solution here |
We are ready to build this and put on a beta while we figure out how we will setup testing itself. |
Reached out to callstack and @fabioh8010 has offered to take this on - See here https://expensify.slack.com/archives/C03UK30EA1Z/p1724426198287819 |
@shawnborton could you update the main description with the final mock and link the figma? Thanks! |
@fabioh8010 this is the beta we will build under #47921 |
Hi, I'm Fábio - expert agency contributor - and I would like to work on this issue. |
I updated the issue description with what's in the threads. No need to read them! :) |
Rather than saying @anmurali @shawnborton @dubielzyk-expensify @jamesdeanexpensify not sure if you agree or like what it currently is more. |
Personally I think we need some kind of verbiage that makes it clear that you are not trying to submit it, so saying "Just track it for now" reads as though you are acknowledging that you are on a submit screen, but you don't want to submit it. Actually my original suggestion was "Don't send this, just track for now" to be extra clear here but I think someone suggested we shorten that. I don't feel too strongly though, happy to go with whatever you all think is best. |
'Just track, don't send (for now)' we could even remove the '(for now)' but I like keeping the affirmative in front. |
I would also be fine doing 'Just track it for now' though. We could perhaps make it a bit clearer as another option by saying 'Or just track it for now' |
Sounds like people like the affirmative so far so happy to stick with what we have right now. It just caught my eye. |
Nice, I still think I like adding the |
I see the Figma file and I asked for edit access. We could look at a few options to see what looks nice? |
Agree with that Mr Borton |
Can we make the title "Submit expense" so we follow the overall language of the product, and not introduce some new concept of "sending an expense to someone"? |
@shawnborton @jamesdeanexpensify |
I would be fine with this! |
Yup, same! |
Update: Working on the proposal / action plan to refactor and develop the combined flow. I plan to post it here tomorrow. |
Update: Validating / polishing the final proposal after encountering some problems. |
Edited by proposal-police: This proposal was edited at 2024-09-03 21:57:42 UTC. ProposalPlease re-state the problem that we are trying to solve in this issue.The vast majority of signups are unengaged. Paid adoption from top or bottom up leads only happens when users are engaged with the product and derive value from it. The Global Create menu is by far the most obvious and accessible option a new user explores to do something. What is the root cause of that problem?The time it takes for a person to make a decision increases with the number and complexity of choices available. Presenting users with too many options like What changes do you think we should make in order to solve the problem?1) Change FloatingActionButtonAndPopover to pass different data to 2) Create a new 3) Modify IOUUtils.isValidMoneyRequestType() to account for the new type (maybe we can also check if user has beta here), so it will allow AccessOrNotFoundWrapper to let the user access the new flow when accessing the IOURequestStartPage page. Additionaly, a new header title will be added for 4) For each tab (Manual 5) In This In case the user select a participant, they will be navigated to With this proposal I believe we can achieve this goal with minimal changes in the code while having support for both There are other minor changes that will be required but the main ones are these. I believe all this can be done in one PR because there isn't too much work / refactoring to do as I noted in my investigations and tests.
As discussed in this issue, the Track Expense onboarding modal won't be shown in the combined Track / Submit flow. What alternative solutions did you explore? (Optional)N/A |
{grgia} Your proposal will be dismissed because you did not follow the proposal template. |
@fabioh8010 I think for this test, it would make sense to just remove the video from the combined flow entirely? Curious what @anmurali thinks too. |
Yeah I don't think we need the video modal there, it looks redundant to me. |
Yes, let's remove that for sure. |
@grgia bump 😄 |
@fabioh8010 Proposal looks good, thank you! Would you update it to specify that we will remove the video from that flow? |
Progress Update
We should have the feature ready to go soon for when we decide how we want to A/B test cc @anmurali |
Updated! |
@fabioh8010 - responding to your question here |
Sorry if I'm coming in late here, but just curious what are we actually A/B testing here? Is it changing the wording from |
Submit/ Track as separate options vs. Create. And where there is only one or the other of the former - that vs. Create. |
@anmurali we've merged the feature. Once it's deployed and passes QA I can merge the code releasing it to half of users |
Problem: The vast majority of signups are unengaged. Paid adoption from top or bottom up leads only happens when users are engaged with the product and derive value from it.
Hypothesis: The time it takes for a person to make a decision increases with the number and complexity of choices available. Presenting users with too many options can lead to decision fatigue, making the user experience overwhelming and less efficient.
Test: The Global Create menu is by far the most obvious and accessible option a new user explores to do something. Let’s make it a smaller, focused list that allows a user to pick one out of a very small set of choices. Instead of asking the user to decide between tracking and submitting an expense, let’s present a create expense that after the expense is manually entered or scanned allows the user to select what they want to do with that expense in the moment.
Metric: conversion in this test would be number of people that create an expense / number of people that see the create expense option Vs sum of the number of people that track or submit an expense / number of people that see track and submit as separate options in Global Create
Notes: We are already cleaning up the GC menu #47274 so we focus the user on a smaller set of realistic actions. Once we do that, we should be ready to test an idea @shawnborton proposed, which is to use one single combined flow that allows the user to first create the expense and in the next step decide to either save it for now or submit to someone.
Let's get started on building this and just put it on a beta for now and don't show it to anyone not on the beta. That way, when we finish cleaning up the GC and figure out how to set up the test, we can turn it on accordingly to the variant audience.
Just track this for now
would basically mimic the track expense flowThe text was updated successfully, but these errors were encountered: