US Secretary of State Mike Pompeo called the meeting "historic" as he flew to Doha for the opening ceremony.The talks were due to start after a US-Taliban security deal in February.
But disagreements over a controversial prisoner swap stalled the next stage, as did violence in Afghanistan, where four decades of war are at a stalemate.
A delegation of leading Afghans left Kabul for Doha on Friday - 11 September, the day 19 years ago of the deadly attacks on the US which led to the end of Taliban rule.
The head of the delegation, Abdullah Abdullah, said they were seeking "a just and dignified peace".
Mr Pompeo told the conference on Saturday the US believed protecting everyone's rights in Afghanistan "is the best way for you to break the cycle of violence", and urged delegates to act "not only for this generation of Afghans but for future generations".On Thursday the Taliban confirmed they would attend, after a final group of six prisoners were released.
At the conference Taliban leader Mullah Baradar Akhund called for Afghanistan to have an "Islamic system in which all tribes and ethnicities... live their lives in love and brotherhood".
"Negotiations may have problems but should move forward with patience," he added.
What to expect from the talks
These are the first direct talks between the Taliban and representatives of the Afghan government. The militants had until now refused to meet the government, calling them powerless and American "puppets".
The two sides are aiming for political reconciliation and an end to decades of violence, which began with the 1979 Soviet invasion.
The talks were meant to begin in March but were repeatedly delayed by a dispute over the prisoner exchange agreed in the February US-Taliban deal, as well as violence in the country.
The separate but linked US-Taliban agreement set out a timetable for the withdrawal of foreign forces, in exchange for counter-terrorism guarantees.
That agreement took over a year to finalise, and the government-Taliban talks are expected to be even more complicated. Many worry that fragile progress made in women's rights could be sacrificed in the process.
The talks also present a challenge to the Taliban, who will have to bring forward a tangible political vision for Afghanistan. They have so far been vague, stating they wish to see an "Islamic" but also "inclusive" government.
The talks may provide more evidence of how the militant group has changed since the 1990s, when they ruled using a harsh interpretation of Sharia law.
Emotional, nervous, cautiously hopeful, worried - just some of the words spoken by Afghans to express their feelings in this moment.
In a country where turning points of the past have veered into yet more violence, everyone speaks of a profound yearning for peace.
But everyone knows too of the hurdles ahead. After the opening speeches, a Taliban leader remarked: "Isn't it better to talk together than to fight each other?"
An Afghan diplomat was at pains to point out that everyone who spoke in the opening ceremony called for a ceasefire - except the Taliban.
But an Afghan politician noted, positively, Taliban leader Mullah Baradar's statement where he mentioned the difficulties, but also the readiness to resolve them.
The words that matter most will come when Afghans sit down for their first formal face-to-face talks. What matters just as much is what happens on the battlefield still burning back home.
What was in February's deal?
The US and its Nato allies agreed to withdraw all troops within 14 months, while the Taliban committed not to allow al-Qaeda or any other extremist group to operate in the areas they control.
The US also agreed to lift sanctions against the Taliban and work with the UN to lift its separate sanctions against the group, as well as cutting its troop numbers in the country from about 12,000 to 8,600 and closing several bases.
US-led troops have been present in Afghanistan for nearly two decades, after launching air strikes to oust the Taliban in 2001 following the deadly 9/11 al-Qaeda attacks in New York. The Taliban, who protected al-Qaeda leader Osama Bin Laden, had refused to hand him over.
The Afghan government did not take part in the February accord, but had expected to begin peace talks with the Taliban in March.
The deal also provided for a prisoner swap of about 5,000 Taliban prisoners and 1,000 detained Afghan security personnel to be finalised before the planned start of the March talks.
What's happened since?
Government and Taliban negotiators disagreed over the numbers of prisoners to be freed and who they would be. The continuing violence also held things up.
Some of the men the Taliban wanted freed were commanders believed to have been involved in major attacks.
"We cannot release the killers of our people," a government negotiator said at the time.
According to a report by the Washington Post last month, three Afghans accused of involvement in the deaths of US troops were also a sticking point.
Progress was slow, but in August the Afghan government began to free the final 400 Taliban prisoners, after the move was approved by a grand assembly, or loya jirga of elders.
Not all of the group of 400 were released straight away, after both France and Australia objected to freeing six prisoners accused of fatal attacks against their nationals, including humanitarian workers.
Their release and transfer to Doha on the eve of talks removed the final hurdle.
The longest US war
At 19 years, the conflict in Afghanistan - codenamed Operation Enduring Freedom and later Operation Freedom's Sentinel - has been the longest in US history.
At the outset in 2001, the US was joined in its fight by an international coalition, and the Taliban were quickly removed from power. But the militant group morphed into an insurgent force that dug in and launched deadly attacks against US-led forces and the Afghan military, as well as Afghan government officials.
The international coalition ended its combat mission in 2014. The total coalition death toll by that point was nearly 3,500. More than 2,400 US military personnel have been killed. The UK lost more than 450 of its soldiers.
The Watson Institute at Brown University estimated in November 2019 that more than 43,000 civilians had been killed, with 64,000 Afghan security personnel and 42,000 anti-government fighters dead. The true numbers will never be known.
The US continued its own, scaled-back combat operation after 2014, including air strikes. The Taliban meanwhile continued to gain momentum and now control more territory than at any time since 2001.